Hyve HS9215—1U, 8x LFF SATA III, 2x SFF SATA III, 2x LGA 2011-3, 2x PCIe 3.0x16, 2x OCP 2.0 with dual 10GbE Intel X520 and LSI SAS2308 - $120 + ship

[Squeegee4943]

Another Hyve server—seems like it's the older brother of the Hyve S-SKUD. Chassis seems identical to the SKUD (are motherboards compatible?). This particular one is an Apple AMP-CONV server, but others are available like APPLE-ISO-FS and APPLE-SIRI-G22T4 with different PSU and storage configurations.

https://www.ebay.com/itm/225310161196?hash=item347588392c:g:McMAAOSw56VjpKKK&amdata=enc:AQAIAAAAwKmGj6tHHuj4g2A0nctj24KI6F/Uc+g//HUsApK1fqCxr+yBKx0N/cqXd5t+CY+r8LVsO+8jpuvG1+cPoC3IKBcNI+n/gsrxKznH9KLSX4ia7D4p0qYSC559Ky32pVjprAFKOVEZu4RJHg2AhZtTv3GgA3843gjfmuSQjYwpIggYnTUlaW6ySozzGv03TN7tCCXbWFyGMrKjmQzIJ2xv/e3y2Ly2qMkOhl0HIQ2l73fmOK1iAj+ftVyD8ePUcdK/dA==|tkp:Bk9SR66gnMmHYg

Other configs are online with different PSUs and storage configurations

This is the first actual prebuilt server I've ever had, so my testing is obviously limited.

Knowns:

Chassis + Hardware:

• 1U chassis, 860mm/34" long
• Dual LGA2011-3 sockets supporting Broadwell V4 (didn't test with Haswell v3), boots both with 1 and 2 CPUs installed
  • Heatsinks come with unit
  • 16 DDR4 DIMM slots, worked with 2133MT/S RDIMMs
• OCP 8-port LSI SAS controller 03:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
• OCP dual 10GbE SFP+ Intel X520/82599ES card 01:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
  • Might come with transceivers, mine came with two Intel ones

• Comes with 8 3.5" trays and 2 2.5" trays that slide and lock into place with the green knurled handles shown in listing

BIOS:

• Seems to be a standard, basic AMI bios
• Dated 2016, so might not have been updated for Meltdown and Spectre
• Wasn't able to find options for PCIe bifurcation
• IOMMU groups seem to be good and functioning

...
IOMMU Group 48:
    00:1d.0 USB controller [0c03]: Intel Corporation C610/X99 series chipset USB Enhanced Host Controller #1 [8086:8d26] (rev 05)
IOMMU Group 49:
    00:1f.0 ISA bridge [0601]: Intel Corporation C610/X99 series chipset LPC Controller [8086:8d44] (rev 05)
    00:1f.2 SATA controller [0106]: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] [8086:8d02] (rev 05)
    00:1f.3 SMBus [0c05]: Intel Corporation C610/X99 series chipset SMBus Controller [8086:8d22] (rev 05)
IOMMU Group 50:
    01:00.0 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)
IOMMU Group 51:
    01:00.1 Ethernet controller [0200]: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection [8086:10fb] (rev 01)
IOMMU Group 52:
    03:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2308 PCI-Express Fusion-MPT SAS-2 [1000:0086] (rev 05)
IOMMU Group 53:
    07:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 03)
    08:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 30)
...

PCIe Expansion + M.2:

• PCIe SLOT_0 (far from PSU) works with just one CPU installed
  • Mine came with a single riser in this slot, works with standard risers / riser cables
• PCIe SLOT_1 (near PSU) works only with two CPUs installed
• Both slots see to support FHHL cards, and work with 75W Tesla P4
• M.2 slot doesn't seem to work at all (tested w/ 1.92TB and 960GB Samsung PM983, 512GB SM961, 500GB 980, and 256GB Intel 7600p), could be due to shipping damage

IPMI / BMC / Fans:

• Able to reset IPMI password with ipmitool:

sudo ipmitool user list 1     # list IPMI users, find one to reset
sudo ipmitool user set password 2 # user 2 has administrator access from output of above

• Uses AST2400 with a basic IPMI interface, and a very terrible Java iKVM that I wasn't able to get working

• Fans: 40mm 21K RPM PWM fans
• Don't seem to be able to unplug fans, causes it to full-speed fans until plugged back in
• Basic noise measurements with my Apple Watch immediately next to intake/exhaust:
  • 80dB on power on, very loud
  • 55dB on POST (about equal to an ICX6450/ICX7250)
• Haven't tested using a resistor to reduce voltage to fans

Motherboard:

• Seems to use standard ATX power—this might be a really cheap way to get a redundant PSU?
• Motherboard has pads for PCIe SSDs, might be floating around on another configuration Hyve Ambient

Power:
Some basic measurements using a Kill-A-Wat connected with an extension cord to both PSUs

• RAM is in 2133MT/s 32GB DIMMs
• CPU(s) are E5-2620V4
• Idle—once booted into AlmaLinux 9.2 not running anything
• Full load—stress-ng across all 32/16 threads running for a few minutes to allow fans to increase speed

About 10W idle once BMC has booted.

CPUs	RAM (GiB)	Idle Power (W)	Idle w/ 3 5400RPM 3.5" HDD (W)	Full Load, no HDD (W)
1	64	54	69	98
1	128	58	74	107
1	256	--	78	114
2	64	68	79	154
2	128	70	80	160
2	256	75	95	178

Shipping Damage:
Came in a very large box, well padded and with foam cutouts to support a 1U device.
Despite that, still had a nasty dent across the bottom that doesn't seem to affect functionality much, seems to have occured before shipping. Causes a power supply to be a bit hard to insert/remove.

 

[itronin]

Welcome to STH! nice write-up and really thorough too. Nice entry level homelab system (or two) for someone as it ticks a lot of boxes!

 

[Cruzader]

Ive been tempted by the 2.5" version of this before, saw somebody on the homelab reddit i think it was that had the 12x2.5" and squeezed in a third row for 18x2.5".
Could probably even double mount them for 36x2.5"

The downside for me was the 2308 mezzanine and finding a cheap 3008 upgrade.
(Since its the standard mezzanine connector instead of the black pci-e x8 with riser pcb, those are 5-6$/ea for 3008)

 

[Fritz]

Does it come with a lid?

 

[Squeegee4943]

Does it come with a lid?

Yep--system came complete with just storage, CPU, and RAM missing.

 

[EasyRhino]

these always seem like an interesting value play.

shipping is $50 to me in california btw.

 

[darkbane0520]

I also just bought one of these (although from a different source) and it has been great apart from the really old BMC where i cant control fan speed. Its an ASPEED at2400 and from what i can tell online its decent but when i access BMC its some hyve solutions OEM version of a BMC gui. I have the very same basic gui that you pictured in original post as well as the unusable java KVM. I try to use ipmitool to send raw hex commands to the server but even still its really limited. I can manage users, interfaces, and print data but cannot control fans. I can use "ipmitool raw" and it lists some network functions but none of them are fan related. any raw hex commands ive seen online use network functions that are different from what I have available and I end up getting "Invalid command". I attached a snip of what i see for available functions. Also doesnt tell me what commands these functions allow

Wondering if you have had any luck accessing a better BMC gui or further controls with ipmitool?

 

[zunder1990]

I got one of those units and wanted to posted some detailed pictures of the mobo since those are lacking online.

http://imgur.com/a/a2vEtAl

 

[Cruzader]

I got one of those units

Are you using (or have tested) the M.2 slot?

Saw OP mentioned his was not working but possibly shipping damage.

 

[zunder1990]

Are you using (or have tested) the M.2 slot?

Saw OP mentioned his was not working but possibly shipping damage.

Yes I will be testing that after a get details worked out with the seller. They sent me the 2.5in version when I ordered the 3.5 version.

 

[zunder1990]

Are you using (or have tested) the M.2 slot?

Saw OP mentioned his was not working but possibly shipping damage.

I got the server up and running. I thought that I had a m2 sata ssd but it turns out it is nvme which does not show up as expected. I will have to order a m2 sata ssd to be able to test this.

 

[iaredavid]

Do the onboard mini-SAS headers work, as well?

 

[danielhitch]

Anybody know of any compatible TPM 2.0 modules for these machines? My guess is that the motherboard is some kind of custom Tyan unit.. Also, will the BIOS be compatible with TPM 2.0?

 

[darkbane0520]

I got the server up and running. I thought that I had a m2 sata ssd but it turns out it is nvme which does not show up as expected. I will have to order a m2 sata ssd to be able to test this.

Were you able to test a sata ssd? Just tried a 500gb Samsung 980 and can’t see it in bios. Confirmed it’s working in windows and can create a volume. I scoured bios but don’t see anything referencing nvme, but I made sure sata mode is AHCI and all pci settings looked good to me.

 

[zunder1990]

Were you able to test a sata ssd? Just tried a 500gb Samsung 980 and can’t see it in bios. Confirmed it’s working in windows and can create a volume. I scoured bios but don’t see anything referencing nvme, but I made sure sata mode is AHCI and all pci settings looked good to me.

No I did not end up ordering one. I opted to connect sata cables to the included hda and call it a day.

 

[darkbane0520]

Are you using (or have tested) the M.2 slot?

Saw OP mentioned his was not working but possibly shipping damage.

Have you tested it yourself? Starting to believe it’s SATA only now. There’s no documentation I can find on it, and my nvme isn’t working at all.

 

[Americanzer0]

So.... in before a certain Oregon Youtuber makes this go away

I can confirm that a SATA drive does not work as well for the m.2 slot....

Next question is what is the rails this thing uses? I thought maybe NR12000 rails would fit and they don't.

Also, you can triple stack 2.5" drives and also the 8087 ports are functional as well... I have 18 drives in it now (mix of both 3.5" and 2.5") also E5-2689v4's are pretty dope in this thing.

 

[Cruzader]

So.... in before a certain Oregon Youtuber makes this go away

The broker i spoke to about these had about 30k left when i talked to them, should have some work ahead to drain the market

Not sure if they are as interesting today unless price has dropped to about half of when the post originaly was tho.

 

[darkbane0520]

So.... in before a certain Oregon Youtuber makes this go away

I can confirm that a SATA drive does not work as well for the m.2 slot....

Next question is what is the rails this thing uses? I thought maybe NR12000 rails would fit and they don't.

Also, you can triple stack 2.5" drives and also the 8087 ports are functional as well... I have 18 drives in it now (mix of both 3.5" and 2.5") also E5-2689v4's are pretty dope in this thing.

Thank you for testing a SATA drive in the m.2 slot.

I bought mine with rails on it, I’ll post which they are as soon as I can figure it out. I haven’t actually rack mounted it yet though, so for all I know they could be bad.

Awesome set up with 18 drives and having them stacked. I use my 8087 ports as well because my HBA broke. I have a pair of E5-2695v4’s in mine and they ripppp.

 

[fwerd]

Greetings,
I just ebayed one of these for $50, installed e5-2680v4 and 32GB of RAM. When I tried to boot, I get stuck with a black screen that says:
"System Booting
This BIOS is compatible for 9215H0
BIOS version: v0.003

(then in the bottom last line it says "Waiting for BMC initialization"

I never managed to get past that since after a minute or so, the system shuts down. Any insight or advice is greatly appreciated.,