Advice for ZFS - storage as backup-target (Veeam and Acronis), 10G

Discussion in 'Solaris, Nexenta, OpenIndiana, and napp-it' started by Stril, Dec 17, 2018.

  1. Stril

    Stril Member

    Joined:
    Sep 26, 2017
    Messages:
    163
    Likes Received:
    9
    Hi!

    I need a new backup-target for Veeam, Acronis Backup and some a fileserver with 3.5 Mio files.

    The server should be able to serve nearly 10G read and write. Hardware is a 36-bay-supermicro-system with 2x Intel E5 2643 v2 and 128 GB RAM.

    At the moment, I need about 70TB.

    I have got a good offer for 10 TB SAS drives.


    Now the question:
    What would you recommend?

    - Option 1: one big, mirrored volume:
    32x 10 TB mirrored --> 140 TB --> 100TB usable
    1x Intel Optane 900 as L2ARC
    sync=disable

    --> Should be fast, but resilver could be slow.


    - Option 2:
    2x 16x 10TB mirrored (2 zpools)

    --> Faster resilver, but slower "day by day"

    ....or would you recommend something else? Is it important to use 2,4,8,16 drives or doesn't this matter?
    Is 128 GB RAM enough, or should I extend?

    Thank you for your advice!

    Stril
     
    #1
  2. dswartz

    dswartz Active Member

    Joined:
    Jul 14, 2011
    Messages:
    369
    Likes Received:
    27
    Having trouble understanding your proposed geometry. Is Option A raid10? If so, sounds reasonable. Not sure an L2ARC makes much sense, since it will be mostly writes.
     
    #2
  3. Stril

    Stril Member

    Joined:
    Sep 26, 2017
    Messages:
    163
    Likes Received:
    9
    Hi!

    Yes, both options are using mirror (Raid 10). I am just unsure, if it is a good idea to use one "huge" pool instead of two smaller ones.
     
    #3
  4. gea

    gea Well-Known Member

    Joined:
    Dec 31, 2010
    Messages:
    2,098
    Likes Received:
    674
    Resilver time may be different but more import is to avoid a high fillrate of the pool as this increases fragmentation and reduce iops. A smaller pool with a high fillrate may be slower regarding resilver time than the larger pool with a lower fillrate. As a thumb rule for a good performance: avoid a fillrate > 80%, best is < 60%

    Mostly an L2Arc is not helpful with 128GB RAM. With very many small files (3.5 Mio) it may be helpful. You can also enable read ahead on the L2Arc. Arcstat will show if you need the L2Arc..

    Number of disks is only relevant for Raid-z and only if compress is not enabled. The number of datadisks as a power of 2 can then make sense for a higher usable capacity. Propably you want to enable lz4 compress. Then do not care about.
     
    #4
Similar Threads: Advice storage
Forum Title Date
Solaris, Nexenta, OpenIndiana, and napp-it ZFS build for VM storage. SSD or HDD pool advice. Jan 19, 2014
Solaris, Nexenta, OpenIndiana, and napp-it Need Advice for local and cloud backup Sep 28, 2017
Solaris, Nexenta, OpenIndiana, and napp-it ZPool Config advice and Napp-IT Smart Test Errors May 2, 2017
Solaris, Nexenta, OpenIndiana, and napp-it Advice upgrading to larger drives [ESXi, OmniOS & Napp-IT] May 5, 2015
Solaris, Nexenta, OpenIndiana, and napp-it ZFS advice on a new Omnios+Napp-it backup server Feb 13, 2014

Share This Page