Performance advice (3x Slow-drives - RAID5) on LSI RAID for ESXI

Discussion in 'RAID Controllers and Host Bus Adapters' started by DanAnd, Jun 14, 2018.

  1. DanAnd

    DanAnd New Member

    Joined:
    Jul 25, 2016
    Messages:
    11
    Likes Received:
    1
    Hi,

    I have a small ESXI host in my homelab which runs a few hours a day for experimental work.
    The parts of the machine are chosen to be either low cost or low power usage:

    2x E52650L on an ZTSYSTEM ACADIA12 board
    128 GB DDR3 ECC
    1x SSD Boot drive connected to the onboard Sata-Port
    3x 3TB Sata drives connect to a LSI SAS2108 Controller (512MB Cache + BBU) -> Fujitsu D2616

    In the first days I ran these three 3TB drives directly on the Mainboard with no RAID at all, but since I would like to have a bit of fault tolerance I added the D2616 (SAS2108) RAID controller and build a RAID 5 out of these 3 drives.

    What I encountered is that the machine is feels slower than using a single drive before.

    The maximum throughput I can see is around :

    fio 50% read/ 50% write:
    512b Blocks: 0,3-0,8 MB/s and 640-1740 IO/s
    1024b Blocks: 0,7-1,6 MB/s and 745-1580 IO/s
    4096b Blocks: 0,6-12,6 MB/s and 150-3130 IO/s
    512kb Blocks: 70-133 MB/s and 140-255 IO/s
    1024kb Blocks: 80-180 MB/s and 75-175 IO/s
    4096kb Blocks: 75-130 MB/s and 20-30 IO/s​

    storcli:

    VD LIST :
    =======
    -------------------------------------------------------------
    DG/VD TYPE State Access Consist Cache Cac sCC Size Name
    -------------------------------------------------------------
    0/0 RAID5 Optl RW Yes RWBC - OFF 5.457 TB
    -------------------------------------------------------------

    PD LIST :
    =======
    --------------------------------------------------------------------------------
    EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type
    --------------------------------------------------------------------------------
    252:0 3 Onln 0 2.728 TB SATA HDD N N 512B WDC WD30EZRX-00MMMB0 U -
    252:1 2 Onln 0 2.728 TB SATA HDD N N 512B WDC WD30EZRX-00MMMB0 U -
    252:2 1 Onln 0 2.728 TB SATA HDD N N 512B WDC WD30EZRX-32D8PB0 U -
    --------------------------------------------------------------------------------

    BBU_Info :
    ========
    -----------------------------------------------------------------------
    Model State RetentionTime Temp Mode MfgDate Next Learn
    -----------------------------------------------------------------------
    iBBU08 Optimal 48 hours + 45C 5 2014/05/27 2018/06/19 01:48:31
    -----------------------------------------------------------------------
    Mode 5: 48+ Hrs retention with a non-transparent learn cycle
    and moderate service life.​




    The more subjective feeling is that the VCenter Appliance runs extremely slow. Also Windows Installations got a pretty slow-down from switching from a single Harddisk to the RAID Controller.


    I have two possibilities to advance my server with no or very low cost:

    1) Exchange the D2616 (SAS2108 with 512MB Cache+BBU) for a IBM M5110 (SAS 2208 with 1GB Cache+BBU)
    2) Running the RAID5 with a 4th drive


    Surely the SAS2208 does have PCIe 3.0 x8 , but the C602 chipset of my mainboard is still PCIe 2.0. Will a SAS2208 Controller enhance the RAID5 performance im comparison to the SAS2108 ?

    What else to consider ?

    Thanks alot.

    Daniel
     
    #1
    Last edited: Jun 14, 2018
  2. i386

    i386 Well-Known Member

    Joined:
    Mar 18, 2016
    Messages:
    1,535
    Likes Received:
    356
    With raid 5/6 you have usually the write performance of a single drive, but reads of n-1 for raid 5, n-2 for raid 6.
    I think for the 50%r / 50%w workload these are good numbers.

    The firmware.
    If it's not the "original" lsi/broadcom firmware it's possible that the firmware was modifid for that oem (eg lower max queue depth).
     
    #2
  3. DanAnd

    DanAnd New Member

    Joined:
    Jul 25, 2016
    Messages:
    11
    Likes Received:
    1
    Thanks a good hint, @i386

    I still use the OEM firmware on the Fujitsu D2616. I will try to cross-flash.

    Is there any advantage on using the SAS2208 instead of a SAS2108 controller in my case?

    Cheers,

    Daniel
     
    #3
Similar Threads: Performance advice
Forum Title Date
RAID Controllers and Host Bus Adapters Need advice to improve DAS performance Sep 29, 2014
RAID Controllers and Host Bus Adapters RAID and AF disk performance Mar 1, 2019
RAID Controllers and Host Bus Adapters poor nvme performance on broadcom 9440-8i / lenovo 530-8i? Feb 15, 2019
RAID Controllers and Host Bus Adapters LSI 9270-8i, inconsistent RAID5 performance with SAS Seagate 4 TB disks Oct 23, 2018
RAID Controllers and Host Bus Adapters LSI SAS2008 Performance - GA-7PESH2 - RAID10 Oct 16, 2018

Share This Page