EU HGST 4U SAS3 12GB/s Storage Enclosure 60 bays £299

denywinarto

Member
Aug 11, 2016
183
21
18
36
I tried using blue WD 1 tb drive to the same spot but it's not detected either...
I have moved the 8tb to 4 different slots, 59, 41,42, 5 but none of them works...
 

Gene

Active Member
Jan 27, 2016
166
29
28
38
Im out of ideas other than bad backplane hardware or maybe backplane firmware too new?
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
Im out of ideas other than bad backplane hardware or maybe backplane firmware too new?
I havent updated the firmware at all though..
The documentation isnt very clear about accessing the rack.
I tried G2's method by connecting RJ45 but i can't get any pings

Could also be chinese made LSI 9300 8e..
but it's still functioning for 11 drives..
Are you using same card 9300 8e?

At this rate the rack is no better than my old server with 12 drives (mobo + 2 PCIE ) :(
Probably something to consider if anyone want to buy this..
 
Last edited:

Gene

Active Member
Jan 27, 2016
166
29
28
38
Dell H3-25553-01A flashed to IT mode is what ive been using successfully for 20+ drives
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
Dell H3-25553-01A flashed to IT mode is what ive been using successfully for 20+ drives
I think Thats the same card i've used before, Dell SC8000, the ports and the shape are exactly the same.
Couldn't get it to load more than 11 drives though

Did you access the rack using lan cable?
Care to point me on how to troublshoot the backplane ?
 

Gene

Active Member
Jan 27, 2016
166
29
28
38
yes that is the same card. I'll see what i can do to backup my hgst firmware and how to access. Maybe i can get you an image to flash
 
Last edited:

Gene

Active Member
Jan 27, 2016
166
29
28
38
HGST user manual. page 71 onwards is relevant - https://www.hgst.com/sites/default/files/resources/4U60-G2-Storage-Enclosure-User-Guide.pdf

maybe someone changed some of the settings in the management interface. Page 72 shows how to use the ethernet management interface. Looking at the list of commands it supports iomconfiguration should be set to dual and the other command that stands out is zonecfg which should be disabled. I havn't connected mine up yet

ok so my enclosure firmware is: 0210 based on what lsscsi says
i installed sg3-utils and lsscsi packages with apt-get then ran:
sudo lsscsi -g | grep encl
output which shows both backplanes:
[0:0:24:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg24
[8:0:2:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg27

see what firmware your enclosure is running. Based on the manual if we can get a copy of the firmware from HGST you can downgrade flash it. I don't see a way for me to read/save the firmware

also i ran sg_scan to show all the devices i have running that the sas card sees and I'm at 28 right now:
sudo sg_scan
/dev/sg0: scsi0 channel=0 id=0 lun=0
etc with 27 more entries
 
Last edited:

denywinarto

Member
Aug 11, 2016
183
21
18
36
HGST user manual. page 71 onwards is relevant - https://www.hgst.com/sites/default/files/resources/4U60-G2-Storage-Enclosure-User-Guide.pdf

maybe someone changed some of the settings in the management interface. Page 72 shows how to use the ethernet management interface. Looking at the list of commands it supports iomconfiguration should be set to dual and the other command that stands out is zonecfg which should be disabled. I havn't connected mine up yet

ok so my enclosure firmware is: 0210 based on what lsscsi says
i installed sg3-utils and lsscsi packages with apt-get then ran:
sudo lsscsi -g | grep encl
output which shows both backplanes:
[0:0:24:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg24
[8:0:2:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg27

see what firmware your enclosure is running. Based on the manual if we can get a copy of the firmware from HGST you can downgrade flash it. I don't see a way for me to read/save the firmware

also i ran sg_scan to show all the devices i have running that the sas card sees and I'm at 28 right now:
sudo sg_scan
/dev/sg0: scsi0 channel=0 id=0 lun=0
etc with 27 more entries
I'm using windows, any idea what's the equivalent command for sudo lsscsi -g | grep encl?
sg_scan returns these:
But i'm running this on host which is connected to the rack with QSFP cable
Code:
PD0     [O]     ATA       WDC WD80EFZX-68U  0A83
PD1     [J]     ATA       WDC WD80EFZX-68U  0A83
PD2     [M]     ATA       WDC WD80EFZX-68U  0A83
PD3     [D]     ATA       WDC WD80EFZX-68U  0A83
PD4     [I]     ATA       WDC WD80EFZX-68U  0A83
PD5     [H]     ATA       WDC WD80EFZX-68U  0A83
PD6     [E]     ATA       WDC WD60EFRX-68L  0A82    
PD7     [F]     ATA       WDC WD60EFRX-68M  0A82     
PD8     [L]     ATA       WDC WD60EFRX-68M  0A82     
PD9     [K]     ATA       WDC WD60EFRX-68L  0A82     
PD10    [G]     ATA       WDC WD60EFRX-68L  0A82     
PD11    [C]     KINGSTON SUV400S37120G  0C3FD6SD  50026B72640383E1
PD12    [N]     COVECUBE  CoveFs__________  0001
Looks like it only reads 11 drives.

Hold on, did you connect your PC to the rack with rj45?
I tried it yesterday but i cant get any pings so i didn't try again
 
Last edited:

Gene

Active Member
Jan 27, 2016
166
29
28
38
I'm using windows, any idea what's the equivalent command for sudo lsscsi -g | grep encl?

Looks like it only reads 11 drives.

Hold on, did you connect your PC to the rack with rj45?
I tried it yesterday but i cant get any pings so i didn't try again
I have not connected up to the rj-45 jack yet. from the manual the ip address for the out of band ethernet on the hgst is static and set to:
ESM A: 192.168.0.10 ESM B: 192.168.0.11

you'd need to manually change your tcp/ip v4 stack on your computer to:
IP address: 192.168.0.20 • Subnet mask: 255.255.255.0 • Gateway: 192.168.0.1
(or something in the 192.168.0.x range unless your router assigns on the 192.168.0.x subnet mine does not. it uses 192.168.1.x)

It's not a web client so you'll have to telnet into it
then use a client like putty to telnet into it on the 192.168.0.10 or .11 addresses

Since you are saying you are using it with windows i can't help there. I've only been using it with linux debian based systems. It is possible the issue could be on the windows side after we do all this. One way to rule that out would be to try temporarily installing openmediavault 3.x (what i use) and see if all the drives show up
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
I have not connected up to the rj-45 jack yet. from the manual the ip address for the out of band ethernet on the hgst is static and set to:
ESM A: 192.168.0.10 ESM B: 192.168.0.11

you'd need to manually change your tcp/ip v4 stack on your computer to:
IP address: 192.168.0.20 • Subnet mask: 255.255.255.0 • Gateway: 192.168.0.1
(or something in the 192.168.0.x range unless your router assigns on the 192.168.0.x subnet mine does not. it uses 192.168.1.x)

It's not a web client so you'll have to telnet into it
then use a client like putty to telnet into it on the 192.168.0.10 or .11 addresses
Ok gonna try that,
I did some more testing,
i removed 1 of the working drives to the slots that didn't work, and guess what.. It's detected!
So it's somehow limited either by the HBA card or by the rack..
HBA bios only lists 11 drives, is it SAS card issue then?
 

Gene

Active Member
Jan 27, 2016
166
29
28
38
sounds like it is the sas card or the driver that is the issue. I'm not sure how to fix that on windows. I'd try a new driver or make sure you have a firmware loaded on the sas card that supports IT mode
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
sounds like it is the sas card or the driver that is the issue. I'm not sure how to fix that on windows. I'd try a new driver or make sure you have a firmware loaded on the sas card that supports IT mode
firmware and driver are already the latest.
Card is chinese made, but it's detected as SAS3008
Code:
C:\Users\Administrator\Documents\9300_8e_Package_P15_IT_FW_BIOS_for_MSDOS_Window
s\sas3flash_win_x64_rel>sas3flash.exe -o -b mptsas3.rom -f SAS9300_8e_IT.bin
Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02)
Copyright 2008-2017 Avago Technologies. All rights reserved.

       Advanced Mode Set

       Adapter Selected is a Avago SAS: SAS3008(C0)

       Executing Operation: Flash Firmware Image

               Firmware Image has a Valid Checksum.
               Firmware Version 15.00.00.00
               Firmware Image compatible with Controller.

               Valid NVDATA Image found.
               NVDATA Major Version 0e.00
               Checking for a compatible NVData image...

               NVDATA Device ID and Chip Revision match verified.
               NVDATA SubSystem Vendor and SubSystem Device ID match verified.
               NVDATA Versions Compatible.
               Valid Initialization Image verified.
               Valid BootLoader Image verified.

               Beginning Firmware Download...
               Firmware Download Successful.

               Verifying Download...

               Firmware Flash Successful.

               Resetting Adapter...
               Adapter Successfully Reset.

               NVDATA Version 0e.00.00.08
       Executing Operation: Flash BIOS Image

               Validating BIOS Image...

               BIOS Header Signature is Valid

               BIOS Image has a Valid Checksum.

               BIOS PCI Structure Signature Valid.

               BIOS Image Compatible with the SAS Controller.

               Attempting to Flash BIOS Image...

               Verifying Download...

               Flash BIOS Image Successful.

       Finished Processing Commands Successfully.
       Exiting SAS3Flash.

C:\Users\Administrator\Documents\9300_8e_Package_P15_IT_FW_BIOS_for_MSDOS_Window
s\sas3flash_win_x64_rel>sas3flash.exe -list
Avago Technologies SAS3 Flash Utility
Version 16.00.00.00 (2017.05.02)
Copyright 2008-2017 Avago Technologies. All rights reserved.

       Adapter Selected is a Avago SAS: SAS3008(C0)

       Controller Number              : 0
       Controller                     : SAS3008(C0)
       PCI Address                    : 00:01:00:00
       SAS Address                    : 500605b-0-0b9f-51ca
       NVDATA Version (Default)       : 0e.00.00.08
       NVDATA Version (Persistent)    : 0e.00.00.08
       Firmware Product ID            : 0x2221 (IT)
       Firmware Version               : 15.00.00.00
       NVDATA Vendor                  : LSI
       NVDATA Product ID              : SAS9300-8e
       BIOS Version                   : 08.35.00.00
       UEFI BSD Version               : 07.00.00.00
       FCODE Version                  : N/A
       Board Name                     : SAS9300-8e
       Board Assembly                 : H3-35661-00V
       Board Tracer Number            : SV61122067

       Finished Processing Commands Successfully.
       Exiting SAS3Flash.
Guess i'm gonna refund this and get the authentic one
 

Gene

Active Member
Jan 27, 2016
166
29
28
38
do you still have the sas 2 controller from before to use in the meantime?
 

Gene

Active Member
Jan 27, 2016
166
29
28
38
Yes i just plugged it back in...why?
It's detecting 11 as well
That would point to it not being the controller and more of an OS issue possibly. I think you should probably try a linux OS just to see if it does the same thing or not. It will help you rule out things. What you posted seems to rule out the sas card the new or the old one as being the issue
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
That would point to it not being the controller and more of an OS issue possibly. I think you should probably try a linux OS just to see if it does the same thing or not. It will help you rule out things. What you posted seems to rule out the sas card the new or the old one as being the issue
Hmm using linux would force me to make alot of changes on my server...
But on the bios both sas card are detecting 11 drives, if it is indeed OS issue then wouldn't it show 12 instead ?

btw what's your drives composition gene?
HGST tech said that if i use 4TB it would get detected
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
HGST user manual. page 71 onwards is relevant - https://www.hgst.com/sites/default/files/resources/4U60-G2-Storage-Enclosure-User-Guide.pdf

maybe someone changed some of the settings in the management interface. Page 72 shows how to use the ethernet management interface. Looking at the list of commands it supports iomconfiguration should be set to dual and the other command that stands out is zonecfg which should be disabled. I havn't connected mine up yet

ok so my enclosure firmware is: 0210 based on what lsscsi says
i installed sg3-utils and lsscsi packages with apt-get then ran:
sudo lsscsi -g | grep encl
output which shows both backplanes:
[0:0:24:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg24
[8:0:2:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg27

see what firmware your enclosure is running. Based on the manual if we can get a copy of the firmware from HGST you can downgrade flash it. I don't see a way for me to read/save the firmware

also i ran sg_scan to show all the devices i have running that the sas card sees and I'm at 28 right now:
sudo sg_scan
/dev/sg0: scsi0 channel=0 id=0 lun=0
etc with 27 more entries
My ip is 192.168.0.200, gateway and subnet are already correct.
This is where i'm stuck,
pinging to .10 and .11 give me destination host unreachable
and thus telnet can't connect to those ip

I'm using sg_utils for windows found here
The sg3_utils package
so far only sg_scan works, but it only returns same hdd list as the disk manager.
it doesn't detect the enclosure,
running other exe gives me "missing device name" what should i name the device?
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
@Gene : could you upload your firmware image somewhere?
Im thinking to flash one of the esm since there are 2 of them with your firmware. I read cyberskulls' post that upgrading firmware is risky.
I wanted to use ubuntu..But i couldnt risk messing the data too.. im worried accessing the drives with ubuntu would mess up with permissions of the file. Since im using drivepool im not sure what happens if its being accessed by ubuntu and then windows.
So im gonna pull out the drives first, then connect the unused esm to ubuntu machine with lsi 9300 8e and upgrade the firmware.. would this work?
This way in case if i screw the firmware upgrading or i got same effect as cyberskulls i still got another esm to work with..
 
Last edited:

Gene

Active Member
Jan 27, 2016
166
29
28
38
Ill try to get registered on the hgst site and see if i can get previous firmware. I dont see a way to save the firmware you have just a way to flash it
 

denywinarto

Member
Aug 11, 2016
183
21
18
36
HGST user manual. page 71 onwards is relevant - https://www.hgst.com/sites/default/files/resources/4U60-G2-Storage-Enclosure-User-Guide.pdf

maybe someone changed some of the settings in the management interface. Page 72 shows how to use the ethernet management interface. Looking at the list of commands it supports iomconfiguration should be set to dual and the other command that stands out is zonecfg which should be disabled. I havn't connected mine up yet

ok so my enclosure firmware is: 0210 based on what lsscsi says
i installed sg3-utils and lsscsi packages with apt-get then ran:
sudo lsscsi -g | grep encl
output which shows both backplanes:
[0:0:24:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg24
[8:0:2:0] enclosu HGST 4U60_STOR_ENCL 0210 - /dev/sg27

see what firmware your enclosure is running. Based on the manual if we can get a copy of the firmware from HGST you can downgrade flash it. I don't see a way for me to read/save the firmware

also i ran sg_scan to show all the devices i have running that the sas card sees and I'm at 28 right now:
sudo sg_scan
/dev/sg0: scsi0 channel=0 id=0 lun=0
etc with 27 more entries
Managed to read the firmware
Looks like the version is still the same as yours
Code:
SCSI3:0,10,0   claimed=0 pdt=dh          HGST      4U60_STOR_ENCL    0210
is 4.21 safe?
IIRC cyberskulls upgraded to FW_v4.2.5 and it screwed up the rack..
@CyberSkulls did you manage to downgrade to previous version?

I managed to fetch some logs using CLI tools, this is under 1 ESM and 1 PSU (plugged out the other ESM and PSU) and port 60 has the undetected 8TB hdd..

Execute Command: about Celestica Tamer CLI All rights reserved. Use is sub - Pastebin.com

HBA log from Dell SC8000
properties_hba1.7z
 
Last edited: