SHOW STH: Flexi Raid - A flexible storage solution on a Linux distro, using off the shelf tools

Discussion in 'Linux Admins, Storage and Virtualization' started by dandanio, Dec 1, 2019.

  1. dandanio

    dandanio Member

    Joined:
    Oct 10, 2017
    Messages:
    64
    Likes Received:
    23
    I have finished a quick guide on how to make a home-made flexible raid solution, something like a commercial vendor would ship:

    flexi-raid.md

    This particular solution has been in operation at several of my clients for years - 4-5 years at minimum. Stable, fast and easy to support.

    Please let me know if you have any questions or comments.
     
    #1
  2. MrCalvin

    MrCalvin IT consultant, Denmark

    Joined:
    Aug 22, 2016
    Messages:
    38
    Likes Received:
    7
    Nice to find some writing on mdadm RAID5/6. I will for sure look into your extensive work and use it as a reference for double checking my own configurations.
    There are many reasons to prefer mdadm over HW RAID. Just the power consumption of a SAS controller is enough to dump it!. We all have a responsibility to lower our power consumption! It seems those LSI controllers, even in non-RAID mode, seem to use 8-15 watt in idle! How much does mdadm consume? One could claim close to nothing.
    I only have one issues with mdadm: KVM and Windows guests.
    It's my experience that good performance of RAID5(6) is only achievable by heavy interaction between mdadm and the host page cache.
    Active use of the page cache I see several hundreds MB/s, with no use it drops to 50MB/s or below (talking HDDs).
    This might not seem as a problem until you start using MS Windows guests on KVM, if the guest-storage is located on a host mdadm RAID5 device. I suspect the problem is precisely caused by issues with madam effective use of the page cache in combination with the Virtio-blk and Virtio-SCSI driver. No matter how my configuration is the result is not really good.
    Yes, you can get initial good performance in some combinations, bot not persistent.
    Any knowledge on this specific matter out there?
    In my tweaking I've already looked at and tested QEMU iothread, IO, host and guest cache settings, QCOW2 and block device and of course both Virtio-blk and Virtio-SCSI drivers.
     
    #2
Similar Threads: SHOW Flexi
Forum Title Date
Linux Admins, Storage and Virtualization ZFS not showing the correct amount? Jan 9, 2018
Linux Admins, Storage and Virtualization Balloon Service not showing correct RAM on Proxmox? Oct 26, 2017

Share This Page