Quick rundown:
RHEL8 running OpenZFS with 35 drives passed to it. I was previously accomplishing this directly with a SAS2008 card because my previous chassis was a SAS-2 backplane which didn't seem to play nice with the 3108. The current state of the system is when I plug-in both backplanes (front = 24 drives | back = 12 drives) the 3108 is able to see all of the drives but within the BIOS it shows them as "Blocked" & I can't take any action on them. From the OS via storcli it shows them as Unconfigured Bad Unsupported drives (previously they were Unconfigured Good Unsupported but I have attempted to correct it to no avail).
Here are the outputs I get when I am connecting all of the drives to the 3108 -- you can see that the set good commands fail for both:
Does anyone have any suggestions on how to fix this?
Currently I am in a working state by plugging in the front backplane (24 drives) into the LSI 2008 & the rear backplane (12 drives) into the 3108 and that seems to be working fine but it is less than ideal. I'd love to have it all just plugged into the 3108 and get rid of the 2008.
RHEL8 running OpenZFS with 35 drives passed to it. I was previously accomplishing this directly with a SAS2008 card because my previous chassis was a SAS-2 backplane which didn't seem to play nice with the 3108. The current state of the system is when I plug-in both backplanes (front = 24 drives | back = 12 drives) the 3108 is able to see all of the drives but within the BIOS it shows them as "Blocked" & I can't take any action on them. From the OS via storcli it shows them as Unconfigured Bad Unsupported drives (previously they were Unconfigured Good Unsupported but I have attempted to correct it to no avail).
Here are the outputs I get when I am connecting all of the drives to the 3108 -- you can see that the set good commands fail for both:
Code:
PD LIST :
=======
-----------------------------------------------------------------------------------
EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type
-----------------------------------------------------------------------------------
40:1 47 JBOD - 12.733 TB SATA HDD N N 512B OOS14000G U -
40:2 48 JBOD - 12.733 TB SATA HDD N N 512B OOS14000G U -
40:3 49 JBOD - 12.733 TB SATA HDD N N 512B OOS14000G U -
40:5 41 JBOD - 10.914 TB SATA HDD N N 512B WDC WD120EMFZ-11A6JA0 U -
40:6 42 JBOD - 10.914 TB SATA HDD N N 512B WDC WD120EMFZ-11A6JA0 U -
40:7 46 JBOD - 14.552 TB SATA HDD N N 512B WDC WD161KRYZ-01AGBB0 U -
40:8 45 JBOD - 14.552 TB SATA HDD N N 512B WDC WD161KRYZ-01AGBB0 U -
40:9 44 JBOD - 12.733 TB SATA HDD Y N 512B WDC WD140EDGZ-11B1PA0 U -
40:10 43 JBOD - 12.733 TB SATA HDD Y N 512B WDC WD140EDGZ-11B1PA0 U -
40:11 50 JBOD - 16.371 TB SATA HDD N N 512B ST18000NM000J-2TV103 U -
40:12 51 JBOD - 16.371 TB SATA HDD N N 512B ST18000NM000J-2TV103 U -
52:1 56 JBOD - 7.277 TB SATA HDD Y N 512B HUH728080ALE601 U -
52:2 66 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00W U -
52:3 53 JBOD - 7.277 TB SATA HDD N N 512B WDC WD80EMAZ-00WJTA0 U -
52:4 62 UBUnsp - 7.276 TB SATA HDD Y N 512B WDC WD80EZAZ-11T U -
52:5 54 JBOD - 7.277 TB SATA HDD N N 512B WDC WD80EMAZ-00WJTA0 U -
52:6 60 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00M U -
52:7 59 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00W U -
52:8 64 UBUnsp - 7.276 TB SATA HDD Y N 512B WDC WD80EDAZ-11T U -
52:9 58 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00M U -
52:10 55 JBOD - 7.277 TB SATA HDD N N 512B WDC WD80EMAZ-00WJTA0 U -
52:11 76 UBUnsp - 7.276 TB SATA HDD N N 512B OOS8000G U -
52:12 68 UBUnsp - 7.276 TB SATA HDD Y N 512B WDC WD80EDAZ-11T U -
52:13 57 JBOD - 7.277 TB SATA HDD N N 512B WDC WD80EMAZ-00WJTA0 U -
52:14 61 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00W U -
52:15 67 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00W U -
52:16 69 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00W U -
52:17 63 UBUnsp - 7.276 TB SATA HDD N N 512B WDC WD80EMAZ-00M U -
52:18 65 UBUnsp - 7.276 TB SATA HDD N N 512B HGST HUS728T8TAL U -
52:19 70 UBUnsp - 12.732 TB SATA HDD N N 512B OOS14000G U -
52:20 71 UBUnsp - 12.732 TB SATA HDD N N 512B OOS14000G U -
52:21 74 UBUnsp - 12.732 TB SATA HDD N N 512B OOS14000G U -
52:22 73 UBUnsp - 12.732 TB SATA HDD N N 512B OOS14000G U -
52:23 75 UBUnsp - 12.732 TB SATA HDD N N 512B OOS14000G U -
52:24 72 UBUnsp - 12.732 TB SATA HDD N N 512B OOS14000G U -
-----------------------------------------------------------------------------------
./storcli64 /c0/e52/s24 set good PLEX
CLI Version = 007.1704.0000.0000 Jan 16, 2021
Operating system = Linux 4.18.0-425.10.1.el8_7.x86_64
Controller = 0
Status = Failure
Description = Set Drive Good Failed.
Detailed Status :
===============
-------------------------------------------------
Drive Status ErrCd ErrMsg
-------------------------------------------------
/c0/e52/s24 Failure 255 Operation not allowed.
-------------------------------------------------
MegaCLI:
megacli -PDMakeGood '-PhysDrv[52:24]' -a0 PLEX
Adapter: 0: Failed to change PD state at EnclId-52 SlotId-24.
Exit Code: 0x01
Currently I am in a working state by plugging in the front backplane (24 drives) into the LSI 2008 & the rear backplane (12 drives) into the 3108 and that seems to be working fine but it is less than ideal. I'd love to have it all just plugged into the 3108 and get rid of the 2008.
Last edited: