Supermicro H12SSW-NT - FreeNAS 11.3-U1 NVMe issues

Discussion in 'Processors and Motherboards' started by chrisk2305, Mar 26, 2020 at 1:31 AM.

  1. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    Hi Guys,

    I just completed my new freenas build with a Supermicro H12SSW-NT Mainboard and an eight Core Epyc 2 CPU. I have connected 4 U.2 NVMe SSDs to the board via two slimsas x8 cable.

    The disks simply won't appear. Neither in GUI nor Shell.

    I spent a good amount of time checking the BIOS and the cabling and finally decided to try the new TrueNAS 12 nightly. And voila - all 4 appeared.

    Do you have any idea what FreeNAS 11.3 may be missing? AMD NVMe driver? I just don't get it.

    Thanks in advance!

    Chris
     
    #1
  2. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    Nobody here with an Epyc 2 System and NVMe drives? Any help is much appreciated!
     
    #2
  3. KarelG

    KarelG New Member

    Joined:
    Jan 29, 2020
    Messages:
    21
    Likes Received:
    5
    FreeNAS is based on FreeBSD, please give a try to some Linux live CD/USB and boot that. Do you see your NVMe drives in dmesg? Also do you see drives in ipmi/web management console? If so, then there is a hope just FreeBSD is missing driver(s) for your NVMe drives... In which case, better is to ask on FreeBSD mailing list -- but after you try to boot FreeBSD 13-current and neither see drives. If you would see drives in 13-current, then ask on FreeNAS mailing list.

    Have fun!
     
    #3
  4. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    Well I tried the TrueNAS 12 nightly (FreeBSD 12, right?) and I can see all 4 drives, so it is definitely a driver issue.
     
    #4
  5. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    Additionally I booted Systemrescue CD via USB drive and all NVMe are getting detected.
     
    #5
  6. Rand__

    Rand__ Well-Known Member

    Joined:
    Mar 6, 2014
    Messages:
    4,020
    Likes Received:
    692
    So you created a bug report? What did they say?
     
    #6
  7. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    I opened a FreeNAS Ticket in their Jira system but no reply yet.
     
    #7
  8. chilipepperz

    chilipepperz Active Member

    Joined:
    Mar 17, 2016
    Messages:
    209
    Likes Received:
    61
    FreeBSD is so far behind Linux in driver support. Remember the c3000 drivers that took like years.

    Hey why use a H12 EPYC system for FreeNAS? Do you have a 48+ drive system? Can you post the build?
     
    #8
  9. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    Why not :) I wanted to have a highly integrated Mainboard with PCIe 4.0 support to be future proof. I am using this (although unsupported by Supermicro) in a 2U BAC4 WIO Chassis with Hybrid backplane (4x NVMe + 8x SATA/SAS) with 64GB RAM, 4x10TB Seagate Exos SAS Disks, 4x4TB WD Red, 2x256GB 860 EVO SSDs (in the rear of the chassis), 2x Samsung U.2 1,96TB SSDs (iSCSI for VMWare), 2x512GB M.2 SK Hynix SSDs in U.2. chassis (as cache for the 4x10TB SAS disks) - at least in theory because of my NVMe issue :-(
     
    #9
    Ahmann Robert likes this.
  10. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
  11. KarelG

    KarelG New Member

    Joined:
    Jan 29, 2020
    Messages:
    21
    Likes Received:
    5
    Chris, nice report, but, I would *strongly* suggest to attach dmesg from FreeBSD boot where you have seen the drives. This way, FreeNAS staff knows what driver issue it is. It's way more convenient (for devs) to see this than to look and search for info about the board and platform on the internet, specially if you have been able to see drives in whatever FreeBSD you tried.
    I suggest this, since this way (supply all you know and is relevant) you may have higher chance to get reply.
     
    #11
  12. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    @KarelG: Yes, you are right. The issue I am facing with posting the dmesg output from TrueNAS nightly is that my NICs don't work in that version so I cannot copy and paste the output. A bit of a dilemma.
     
    #12
  13. KarelG

    KarelG New Member

    Joined:
    Jan 29, 2020
    Messages:
    21
    Likes Received:
    5
    Save dmesg to usb flash. Or create newfs on drive accessible from older FreeNAS and save it there, or ... well, there is a lot of ways to do. In the worst case, show dmesg on the screen/terminal and then shoot with your mobilephone and post there picture. -- this way, scroll dmesg to part showing drives of course (and driver). Etc.
     
    #13
    chrisk2305 likes this.
  14. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
  15. chrisk2305

    chrisk2305 Member

    Joined:
    Jan 25, 2017
    Messages:
    33
    Likes Received:
    2
    I attached both dmesg outputs to the Jira Ticket.
     
    #15
  16. KarelG

    KarelG New Member

    Joined:
    Jan 29, 2020
    Messages:
    21
    Likes Received:
    5
    Thanks, for me it is always interesting to see dmesg of such machines. Clearly nvd driver is either missing or pcie traversal buggy on 11.3. Fortunately for you, there is already man assigned to your task so good that you have provided this info...
     
    #16
Similar Threads: Supermicro H12SSW-NT
Forum Title Date
Processors and Motherboards Can you use E5-4XXXL processors on single proc m/b? Supermicro X10SRM-TF Yesterday at 11:32 PM
Processors and Motherboards Supermicro X9SRL-F does not boot Yesterday at 8:13 AM
Processors and Motherboards Can't install Windows 10 on a Supermicro H11DSi Friday at 1:36 AM
Processors and Motherboards Need help choosing scrap-price Xeons for Supermicro X9DRi Mar 23, 2020
Processors and Motherboards Cooling options for a Supermicro X10DRL-CT Mar 23, 2020

Share This Page