X9DRD-7LNF4 onboard LSI 2308 SR-IOV not capable?

Discussion in 'RAID Controllers and Host Bus Adapters' started by chinesestunna, Jul 16, 2018.

  1. chinesestunna

    chinesestunna Active Member

    Joined:
    Jan 23, 2015
    Messages:
    516
    Likes Received:
    102
    Hi folks,

    Still tinkering with my new build, with my X9DRD-7LNF4 board and onboard LSI2308 controll, it doesn't seem to allow me to configure SR-IOV in ESXi 6.7. I've done the install and enabled all relevant options I can find in the BIOS but VMWare reports the device as not being SR-IOV capable.
    The only thing I can think of is the IT BIOS I flashed for full device passthrough to the NAS VM. Ideally I'd like to have the ports split between 2 VMs running drives off expanders.

    Any ideas?
     
    #1
  2. rune-san

    rune-san Member

    Joined:
    Feb 7, 2014
    Messages:
    72
    Likes Received:
    14
    It should support SR IOV in IT Mode without any issues. Your second comment about splitting ports is a solid "no". The Controller is what you're passing through, and all the SAS Ports split from there. You're not going to be able to split the ports between different VMs. Did you try vSphere 6.5 or similar to rule out any 6.7 foolery?
     
    #2
  3. chinesestunna

    chinesestunna Active Member

    Joined:
    Jan 23, 2015
    Messages:
    516
    Likes Received:
    102
    Hmmm I'll check out 6.5 if possible. Seems there's very little documentation/info on people using SRIOV when it comes to storage, I may have been mistaken on what it does? My understanding was that you're able to "split" the PCIe device resources amongst several VMs? The onboard quad LAN Intel i350 is reported SRIOV capable in ESXi 6.7 and presents as 4 distinct devices to passthrough
     
    #3
  4. rune-san

    rune-san Member

    Joined:
    Feb 7, 2014
    Messages:
    72
    Likes Received:
    14
    My apologies, I had this confused with you attempting to do IOMMU, to pass through a device to a VM. You are *only* doing SR-IOV, where you want ESXi to control the device, and break it up into virtual devices for other VMs to use.

    Technically this is possible, but not with ESXi. As far as I know VMware has only ever qualified Network Adapters (and Infiniband Adapters in Ethernet Mode) to work with this virtual function breakup. There is no SAS Controller (or anything else really) on their HCL for SR-IOV.
     
    #4
  5. zir_blazer

    zir_blazer Active Member

    Joined:
    Dec 5, 2016
    Messages:
    155
    Likes Received:
    46
    #5
  6. chinesestunna

    chinesestunna Active Member

    Joined:
    Jan 23, 2015
    Messages:
    516
    Likes Received:
    102
    Thanks @zir_blazer
    The idea (in my head) was to have each of the 2 SAS connectors split to a separate VM, I have expanders and that would allow each VM to have many drives attached to them. As you and @rune-san mentioned and in that thread, this seems more trouble than it's worth but it was a "cool let me try this out" idea
     
    #6
  7. vanfawx

    vanfawx Active Member

    Joined:
    Jan 4, 2015
    Messages:
    252
    Likes Received:
    40
    As far as I know, SR-IOV on SAS would work like a zoned fabric. You would have to map drives to each virtual function. Though how this would be accomplished, I have no idea. With SAS Switches, they provide a utility that lets you configure zoning based on the WWPN/WWNN of the HBA.

    If you make any progress, please share! :)
     
    #7
  8. chinesestunna

    chinesestunna Active Member

    Joined:
    Jan 23, 2015
    Messages:
    516
    Likes Received:
    102
    @vanfawx that was what I sort of thought as well, SAS basically works on a network/address based topology and has been very kind with multipath and expander/backplanes vs. SATA before it. I've stop messing with this as it's my production home server and can't have it down all the time :)
     
    #8
  9. kapone

    kapone Active Member

    Joined:
    May 23, 2015
    Messages:
    457
    Likes Received:
    159
    This is one of those things on my list of "gotta try it", but never gotten around to. I'm sure you'e seen this VMware Knowledge Base, but on the off chance that you haven't...

    I know you said, you enabled all the right BIOS options etc...BUT..esxi disables "Virtual Functions" by default..so..

     
    #9
  10. chinesestunna

    chinesestunna Active Member

    Joined:
    Jan 23, 2015
    Messages:
    516
    Likes Received:
    102
    I have not seen that article! Thank you for pointing it out, couple things I can update based on my observations so far:
    1. If one uses the compatible hardware list from VMWare, LSI literally has "0" devices that has SR-IOV supported by ESXi (bummer), just as @rune-san mentioned above - if one searches for all hardware supporting SR-IOV it's all network or FCoE stuff
    2. I did not manually enable SR-IOV from console commands, but the article seems to reference ESXi 5.1/5.5, running 6.7 the host picked up the onboard quad port Intel i-350 LAN no problem, SR-IOV capable and all, this leads me to believe it's more issue on the SAS specific or VMWare support side of things
    Thanks for the info again
     
    #10
  11. kapone

    kapone Active Member

    Joined:
    May 23, 2015
    Messages:
    457
    Likes Received:
    159
    Yup, it was for the 5.x version of ESXI. And my google-fu turned up almost nothing in terms of SAS SR-IOV and ESXI. I suspect there is a reason for it...it's a driver limitation....by design.

    With SR-IOV storage clustering/SDS would be much much easier...and guess what that will do to the Vmware VSAN sales... ;)
     
    #11
  12. chinesestunna

    chinesestunna Active Member

    Joined:
    Jan 23, 2015
    Messages:
    516
    Likes Received:
    102
    Nice case of "just because you could, doesn't mean you should" ;)
     
    #12
Similar Threads: X9DRD-7LNF4 onboard
Forum Title Date
RAID Controllers and Host Bus Adapters X9DRH-7F onboard LSI 2208 16 drive limit Jun 13, 2018
RAID Controllers and Host Bus Adapters Supermicro onboard LSI3008 from IR to IT mode Mar 16, 2018
RAID Controllers and Host Bus Adapters x9drl-f7 onboard 2208 flash (IT) problems Dec 16, 2017
RAID Controllers and Host Bus Adapters Conflict between LSI in PCI-E 1.1 x4 slot and onboard SATA2 ports Apr 15, 2017
RAID Controllers and Host Bus Adapters Updating onboard LSI Jul 11, 2016

Share This Page