EU HGST 4U SAS3 12GB/s Storage Enclosure 60 bays £299

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

ecosse

Active Member
Jul 2, 2013
463
111
43
So I sometimes had strange behaviour where drives weren't detected properly until a second reboot (if I remember correctly new ones were detected though, but old ones went offline in Windows for some reason. Sounds almost witch-doctorish but might be worth a shot.
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
Tried rebooting the host and jbod several times.. still no luck..
It's not offline actually, it's practically nonexistent, i can't find it in explorer or disk management.
Good news is, i switched to another slot in chassis, but it's still not detected,
so the problem is not in the chassis, probably need to config something with the SAS card?
Can anyone recommend a good sas card for this chassis?
I might wanna buy for another one to replace this or as a backup..

Edit : here's my sas2flash result,


Code:
C:\9202-16e_Package_P20_IT_FW_BIOS_for_MSDOS_Windows\sas2flash_win_x64_rel>sas2f
lash -listall
LSI Corporation SAS2 Flash Utility
Version 20.00.00.00 (2014.09.18)
Copyright (c) 2008-2014 LSI Corporation. All rights reserved

        Adapter Selected is a LSI SAS: SAS2308_2(D1)

Num   Ctlr            FW Ver        NVDATA        x86-BIOS         PCI Addr
----------------------------------------------------------------------------

0  SAS2308_2(D1)   20.00.07.00    14.01.00.06    07.39.02.00     00:03:00:00
1  SAS2308_2(D1)   20.00.07.00    14.01.00.06    07.39.02.00     00:05:00:00

        Finished Processing Commands Successfully.
        Exiting SAS2Flash.

C:\9202-16e_Package_P20_IT_FW_BIOS_for_MSDOS_Windows\sas2flash_win_x64_rel>sas2f
lash -list
LSI Corporation SAS2 Flash Utility
Version 20.00.00.00 (2014.09.18)
Copyright (c) 2008-2014 LSI Corporation. All rights reserved
        Adapter Selected is a LSI SAS: SAS2308_2(D1)

        Controller Number              : 0
        Controller                     : SAS2308_2(D1)
        PCI Address                    : 00:03:00:00
        SAS Address                    : 500605b-0-09b5-2610
        NVDATA Version (Default)       : 14.01.00.06
        NVDATA Version (Persistent)    : 14.01.00.06
        Firmware Product ID            : 0x2214 (IT)
        Firmware Version               : 20.00.07.00
        NVDATA Vendor                  : LSI
        NVDATA Product ID              : SAS9206-16e
        BIOS Version                   : 07.39.02.00
        UEFI BSD Version               : N/A
        FCODE Version                  : N/A
        Board Name                     : SAS9206-16E
        Board Assembly                 : H3-25553-01A
        Board Tracer Number            : SV44340003

        Finished Processing Commands Successfully.
        Exiting SAS2Flash.
 
Last edited:

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
Well i contacted HGST and they said alot some of their customers seen some issues for sas2 cards, eg. Unable to support a certain qty of hdds, and unable to identify the hdds, and they recommend upgrading to sas3 card.

Found some cheap (~$200) chinese LSI 9300-8e cards on ebay, is this legit or should i get the more expensive ones from europe/US ?

She also sent me the list of compatible cards, some people seem to have problem finding the compatible cards, so i'm putting it here..
I didn't see my card listed there so this might be accurate
 

Attachments

  • Like
Reactions: ecosse

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
Well this is strange, even with LSI 9300-8e card my 12th disk still refuses to be detected.
I have updated the driver to the latest version, using windows 2012 r2 drivers here
SAS 9300-8e Host Bus Adapter
Btw im using the cheaper chinese version though.. that could be a factor as well...



Do i need to flash it or something?

Edit : Flashed it to latest firmware 15.00,
Code:
C:\Users\Administrator\Documents\9300_8e_Package_P15_IT_FW_BIOS_for_MSDOS_Window
s\sas3flash_win_x64_rel>sas3flash.exe -o -b mptsas3.rom -f SAS9300_8e_IT.bin
Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02)
Copyright 2008-2017 Avago Technologies. All rights reserved.

        Advanced Mode Set

        Adapter Selected is a Avago SAS: SAS3008(C0)

        Executing Operation: Flash Firmware Image

                Firmware Image has a Valid Checksum.
                Firmware Version 15.00.00.00
                Firmware Image compatible with Controller.

                Valid NVDATA Image found.
                NVDATA Major Version 0e.00
                Checking for a compatible NVData image...

                NVDATA Device ID and Chip Revision match verified.
                NVDATA SubSystem Vendor and SubSystem Device ID match verified.
                NVDATA Versions Compatible.
                Valid Initialization Image verified.
                Valid BootLoader Image verified.

                Beginning Firmware Download...
                Firmware Download Successful.

                Verifying Download...

                Firmware Flash Successful.

                Resetting Adapter...
                Adapter Successfully Reset.

                NVDATA Version 0e.00.00.08
        Executing Operation: Flash BIOS Image

                Validating BIOS Image...

                BIOS Header Signature is Valid

                BIOS Image has a Valid Checksum.

                BIOS PCI Structure Signature Valid.

                BIOS Image Compatible with the SAS Controller.

                Attempting to Flash BIOS Image...

                Verifying Download...

                Flash BIOS Image Successful.

        Finished Processing Commands Successfully.
        Exiting SAS3Flash.

C:\Users\Administrator\Documents\9300_8e_Package_P15_IT_FW_BIOS_for_MSDOS_Window
s\sas3flash_win_x64_rel>sas3flash.exe -list
Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02)
Copyright 2008-2017 Avago Technologies. All rights reserved.

        Adapter Selected is a Avago SAS: SAS3008(C0)

        Controller Number              : 0
        Controller                     : SAS3008(C0)
        PCI Address                    : 00:01:00:00
        SAS Address                    : 500605b-0-0b9f-51ca
        NVDATA Version (Default)       : 0e.00.00.08
        NVDATA Version (Persistent)    : 0e.00.00.08
        Firmware Product ID            : 0x2221 (IT)
        Firmware Version               : 15.00.00.00
        NVDATA Vendor                  : LSI
        NVDATA Product ID              : SAS9300-8e
        BIOS Version                   : 08.35.00.00
        UEFI BSD Version               : 07.00.00.00
        FCODE Version                  : N/A
        Board Name                     : SAS9300-8e
        Board Assembly                 : H3-35661-00V
        Board Tracer Number            : SV61122067

        Finished Processing Commands Successfully.
        Exiting SAS3Flash.

C:\Users\Administrator\Documents\9300_8e_Package_P15_IT_FW_BIOS_for_MSDOS_Window
s\sas3flash_win_x64_rel>
still no difference, i'm beginning to think this is rack's issue.. It's been a while but IIRC do i need to access the rack using console cable?

Another note : the led indicator for the new drive doesn't blink, the older drives blinking green in turns...
 
Last edited:

Gene

Active Member
Jan 27, 2016
171
32
28
41
Are you using two sas cables? One time i had to move multiple hard drives around in slots to see every drive but im over 20 now and they all still show up. Sas 2 controller
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
Are you using two sas cables? One time i had to move multiple hard drives around in slots to see every drive but im over 20 now and they all still show up. Sas 2 controller
Yes, 2 QSFP cables to ESM A and B. I've moved the drive to another slot but it was one the same right side. Will try the left side tomorrow. The drive led isnt blinking though..

I cant figure out how to use command line via rj45 though.. looks like the guide for gen2 doesnt work for gen1.. any idea how to troubleshoot hdd port correctly?
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
I had a thought. Is this one of the new wd 8tb drives that you need to put tape over the 3.3 volt power connectors or the drive wont turn on? NEBB drive model?

WD 8TB White Label 3.3v pin question • r/DataHoarder
Its a regular red wd 8tb, the exact same type worked fine, there are like 5 of them

https://www.amazon.com/gp/aw/d/B01BYLY4DM/ref=cm_cr_arp_mb_bdcrb_top?ie=UTF8

Tested and worked on other machine, so i doubt its the drive..
Really hope it isnt the rack.. spent too much for customs and shipment for a 11 bay rack :(
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
I tried using blue WD 1 tb drive to the same spot but it's not detected either...
I have moved the 8tb to 4 different slots, 59, 41,42, 5 but none of them works...
 

Gene

Active Member
Jan 27, 2016
171
32
28
41
Im out of ideas other than bad backplane hardware or maybe backplane firmware too new?
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
Im out of ideas other than bad backplane hardware or maybe backplane firmware too new?
I havent updated the firmware at all though..
The documentation isnt very clear about accessing the rack.
I tried G2's method by connecting RJ45 but i can't get any pings

Could also be chinese made LSI 9300 8e..
but it's still functioning for 11 drives..
Are you using same card 9300 8e?

At this rate the rack is no better than my old server with 12 drives (mobo + 2 PCIE ) :(
Probably something to consider if anyone want to buy this..
 
Last edited:

Gene

Active Member
Jan 27, 2016
171
32
28
41
Dell H3-25553-01A flashed to IT mode is what ive been using successfully for 20+ drives
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
Dell H3-25553-01A flashed to IT mode is what ive been using successfully for 20+ drives
I think Thats the same card i've used before, Dell SC8000, the ports and the shape are exactly the same.
Couldn't get it to load more than 11 drives though

Did you access the rack using lan cable?
Care to point me on how to troublshoot the backplane ?
 

Gene

Active Member
Jan 27, 2016
171
32
28
41
yes that is the same card. I'll see what i can do to backup my hgst firmware and how to access. Maybe i can get you an image to flash
 
Last edited:

Gene

Active Member
Jan 27, 2016
171
32
28
41
HGST user manual. page 71 onwards is relevant - https://www.hgst.com/sites/default/files/resources/4U60-G2-Storage-Enclosure-User-Guide.pdf

maybe someone changed some of the settings in the management interface. Page 72 shows how to use the ethernet management interface. Looking at the list of commands it supports iomconfiguration should be set to dual and the other command that stands out is zonecfg which should be disabled. I havn't connected mine up yet

ok so my enclosure firmware is: 0210 based on what lsscsi says
i installed sg3-utils and lsscsi packages with apt-get then ran:
sudo lsscsi -g | grep encl
output which shows both backplanes:
[0:0:24:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg24
[8:0:2:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg27

see what firmware your enclosure is running. Based on the manual if we can get a copy of the firmware from HGST you can downgrade flash it. I don't see a way for me to read/save the firmware

also i ran sg_scan to show all the devices i have running that the sas card sees and I'm at 28 right now:
sudo sg_scan
/dev/sg0: scsi0 channel=0 id=0 lun=0
etc with 27 more entries
 
Last edited:

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
HGST user manual. page 71 onwards is relevant - https://www.hgst.com/sites/default/files/resources/4U60-G2-Storage-Enclosure-User-Guide.pdf

maybe someone changed some of the settings in the management interface. Page 72 shows how to use the ethernet management interface. Looking at the list of commands it supports iomconfiguration should be set to dual and the other command that stands out is zonecfg which should be disabled. I havn't connected mine up yet

ok so my enclosure firmware is: 0210 based on what lsscsi says
i installed sg3-utils and lsscsi packages with apt-get then ran:
sudo lsscsi -g | grep encl
output which shows both backplanes:
[0:0:24:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg24
[8:0:2:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg27

see what firmware your enclosure is running. Based on the manual if we can get a copy of the firmware from HGST you can downgrade flash it. I don't see a way for me to read/save the firmware

also i ran sg_scan to show all the devices i have running that the sas card sees and I'm at 28 right now:
sudo sg_scan
/dev/sg0: scsi0 channel=0 id=0 lun=0
etc with 27 more entries
I'm using windows, any idea what's the equivalent command for sudo lsscsi -g | grep encl?
sg_scan returns these:
But i'm running this on host which is connected to the rack with QSFP cable
Code:
PD0     [O]     ATA       WDC WD80EFZX-68U  0A83
PD1     [J]     ATA       WDC WD80EFZX-68U  0A83
PD2     [M]     ATA       WDC WD80EFZX-68U  0A83
PD3     [D]     ATA       WDC WD80EFZX-68U  0A83
PD4     [I]     ATA       WDC WD80EFZX-68U  0A83
PD5     [H]     ATA       WDC WD80EFZX-68U  0A83
PD6     [E]     ATA       WDC WD60EFRX-68L  0A82    
PD7     [F]     ATA       WDC WD60EFRX-68M  0A82     
PD8     [L]     ATA       WDC WD60EFRX-68M  0A82     
PD9     [K]     ATA       WDC WD60EFRX-68L  0A82     
PD10    [G]     ATA       WDC WD60EFRX-68L  0A82     
PD11    [C]     KINGSTON SUV400S37120G  0C3FD6SD  50026B72640383E1
PD12    [N]     COVECUBE  CoveFs__________  0001
Looks like it only reads 11 drives.

Hold on, did you connect your PC to the rack with rj45?
I tried it yesterday but i cant get any pings so i didn't try again
 
Last edited:

Gene

Active Member
Jan 27, 2016
171
32
28
41
I'm using windows, any idea what's the equivalent command for sudo lsscsi -g | grep encl?

Looks like it only reads 11 drives.

Hold on, did you connect your PC to the rack with rj45?
I tried it yesterday but i cant get any pings so i didn't try again
I have not connected up to the rj-45 jack yet. from the manual the ip address for the out of band ethernet on the hgst is static and set to:
ESM A: 192.168.0.10 ESM B: 192.168.0.11

you'd need to manually change your tcp/ip v4 stack on your computer to:
IP address: 192.168.0.20 • Subnet mask: 255.255.255.0 • Gateway: 192.168.0.1
(or something in the 192.168.0.x range unless your router assigns on the 192.168.0.x subnet mine does not. it uses 192.168.1.x)

It's not a web client so you'll have to telnet into it
then use a client like putty to telnet into it on the 192.168.0.10 or .11 addresses

Since you are saying you are using it with windows i can't help there. I've only been using it with linux debian based systems. It is possible the issue could be on the windows side after we do all this. One way to rule that out would be to try temporarily installing openmediavault 3.x (what i use) and see if all the drives show up
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
I have not connected up to the rj-45 jack yet. from the manual the ip address for the out of band ethernet on the hgst is static and set to:
ESM A: 192.168.0.10 ESM B: 192.168.0.11

you'd need to manually change your tcp/ip v4 stack on your computer to:
IP address: 192.168.0.20 • Subnet mask: 255.255.255.0 • Gateway: 192.168.0.1
(or something in the 192.168.0.x range unless your router assigns on the 192.168.0.x subnet mine does not. it uses 192.168.1.x)

It's not a web client so you'll have to telnet into it
then use a client like putty to telnet into it on the 192.168.0.10 or .11 addresses
Ok gonna try that,
I did some more testing,
i removed 1 of the working drives to the slots that didn't work, and guess what.. It's detected!
So it's somehow limited either by the HBA card or by the rack..
HBA bios only lists 11 drives, is it SAS card issue then?
 

Gene

Active Member
Jan 27, 2016
171
32
28
41
sounds like it is the sas card or the driver that is the issue. I'm not sure how to fix that on windows. I'd try a new driver or make sure you have a firmware loaded on the sas card that supports IT mode
 

denywinarto

Active Member
Aug 11, 2016
238
29
28
40
sounds like it is the sas card or the driver that is the issue. I'm not sure how to fix that on windows. I'd try a new driver or make sure you have a firmware loaded on the sas card that supports IT mode
firmware and driver are already the latest.
Card is chinese made, but it's detected as SAS3008
Code:
C:\Users\Administrator\Documents\9300_8e_Package_P15_IT_FW_BIOS_for_MSDOS_Window
s\sas3flash_win_x64_rel>sas3flash.exe -o -b mptsas3.rom -f SAS9300_8e_IT.bin
Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02)
Copyright 2008-2017 Avago Technologies. All rights reserved.

       Advanced Mode Set

       Adapter Selected is a Avago SAS: SAS3008(C0)

       Executing Operation: Flash Firmware Image

               Firmware Image has a Valid Checksum.
               Firmware Version 15.00.00.00
               Firmware Image compatible with Controller.

               Valid NVDATA Image found.
               NVDATA Major Version 0e.00
               Checking for a compatible NVData image...

               NVDATA Device ID and Chip Revision match verified.
               NVDATA SubSystem Vendor and SubSystem Device ID match verified.
               NVDATA Versions Compatible.
               Valid Initialization Image verified.
               Valid BootLoader Image verified.

               Beginning Firmware Download...
               Firmware Download Successful.

               Verifying Download...

               Firmware Flash Successful.

               Resetting Adapter...
               Adapter Successfully Reset.

               NVDATA Version 0e.00.00.08
       Executing Operation: Flash BIOS Image

               Validating BIOS Image...

               BIOS Header Signature is Valid

               BIOS Image has a Valid Checksum.

               BIOS PCI Structure Signature Valid.

               BIOS Image Compatible with the SAS Controller.

               Attempting to Flash BIOS Image...

               Verifying Download...

               Flash BIOS Image Successful.

       Finished Processing Commands Successfully.
       Exiting SAS3Flash.

C:\Users\Administrator\Documents\9300_8e_Package_P15_IT_FW_BIOS_for_MSDOS_Window
s\sas3flash_win_x64_rel>sas3flash.exe -list
Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02)
Copyright 2008-2017 Avago Technologies. All rights reserved.

       Adapter Selected is a Avago SAS: SAS3008(C0)

       Controller Number              : 0
       Controller                     : SAS3008(C0)
       PCI Address                    : 00:01:00:00
       SAS Address                    : 500605b-0-0b9f-51ca
       NVDATA Version (Default)       : 0e.00.00.08
       NVDATA Version (Persistent)    : 0e.00.00.08
       Firmware Product ID            : 0x2221 (IT)
       Firmware Version               : 15.00.00.00
       NVDATA Vendor                  : LSI
       NVDATA Product ID              : SAS9300-8e
       BIOS Version                   : 08.35.00.00
       UEFI BSD Version               : 07.00.00.00
       FCODE Version                  : N/A
       Board Name                     : SAS9300-8e
       Board Assembly                 : H3-35661-00V
       Board Tracer Number            : SV61122067

       Finished Processing Commands Successfully.
       Exiting SAS3Flash.
Guess i'm gonna refund this and get the authentic one