Hi,
Two Supermicro BPN-SAS-216A with 42 drives connected (open frame), LSI HBAs (2x9400-16i & 9200-8i) and a RES3TV360.
Drives are 4/5TB Seagate 2.5" SATAs. EXT4 formatted JBOD.
Corsair HX1200
Ubuntu 20.04
There seems to be no rhyme nor reason, every time I reboot some of the drives don't come up, once I figure out which ones are missing (a few days ago 6 were missing) a hot-unplug followed by a hot-plug usually gets them listed in lsblk. I'm using the UUIDs in fstab to mount it all the issue is the drives don't exist in lsblk.
Maybe it's SAS cables, dust, heat, power, HBA/expander firmwares or fsck-on-boot issues, I don't really know where to start.
Anyone had similar issues?
My train of thought was around power, the SATA 2.5" drives are 5V motors and most modern PSU's have weak 5V rails, I doubt the backplanes are converting 12V to 5V and 40 drives at 3.75W startup is 150W (HX1200 has 150W on the 5V rail). The backplanes maybe do staggered spinup, I'm not sure, the capacitors on them may dampen the spinup "surge".
Maybe most of the most recent drive issues are off the 2nd BPN-SAS-216A which has the RES3TV360.
I've also started thinking that Linux might boot too quickly to properly support 40+ JBOD drives.
Or it could be connectors.
Or maybe I need to upgrade firmwares, if it's that, I have no real idea how to do Intel expander firmware with LSI HBAs.
Thanks for looking.
Cheers
Richard
Two Supermicro BPN-SAS-216A with 42 drives connected (open frame), LSI HBAs (2x9400-16i & 9200-8i) and a RES3TV360.
Drives are 4/5TB Seagate 2.5" SATAs. EXT4 formatted JBOD.
Corsair HX1200
Ubuntu 20.04
There seems to be no rhyme nor reason, every time I reboot some of the drives don't come up, once I figure out which ones are missing (a few days ago 6 were missing) a hot-unplug followed by a hot-plug usually gets them listed in lsblk. I'm using the UUIDs in fstab to mount it all the issue is the drives don't exist in lsblk.
Maybe it's SAS cables, dust, heat, power, HBA/expander firmwares or fsck-on-boot issues, I don't really know where to start.
Anyone had similar issues?
My train of thought was around power, the SATA 2.5" drives are 5V motors and most modern PSU's have weak 5V rails, I doubt the backplanes are converting 12V to 5V and 40 drives at 3.75W startup is 150W (HX1200 has 150W on the 5V rail). The backplanes maybe do staggered spinup, I'm not sure, the capacitors on them may dampen the spinup "surge".
Maybe most of the most recent drive issues are off the 2nd BPN-SAS-216A which has the RES3TV360.
I've also started thinking that Linux might boot too quickly to properly support 40+ JBOD drives.
Or it could be connectors.
Or maybe I need to upgrade firmwares, if it's that, I have no real idea how to do Intel expander firmware with LSI HBAs.
Thanks for looking.
Cheers
Richard
Last edited: