Enterprise SSD "small deals"

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

roberth58

Member
Nov 5, 2014
61
14
8
63
Florida
Not that I'm going to do anything like this now, 'cuz I've got too many projects going ATM. BUT, I can see myself wanting/needing to know about this in the future, so best to ask while its fresh:

Which model PSUs are those (I can't make out much detail in the photos)? Are those HP PDBs? Do you maybe have the model on those as well?

Thanks for any info or insights. Sorry to everyone for taking the thread off on a tangent.
They look like standard HP DL server power supplies, blue label are 460W.
 
D

Deleted member 24947

Guest
Of course, if the Backplate does NOT do sequential HDD Spinup, you don't really have a Choice. The Startup Current of 12 HDDs all at once will require a ~ 1kW PSU no Matter what. It would trip due to Overcurrent otherwise :rolleyes: .
No way. Worst case power draw is about 30 watts on startup. That’s only 360 watts for 12 drives. A 1000 watt PSU is absolutely not necessary.
 

miraculix

Active Member
Mar 6, 2015
167
59
28
Tread carefully with egoodssupply
Sorry to hear you've been having all that trouble with them. Disclaimer: I haven't bought SSDs from them yet, only 16-20TB Toshiba and Seagate Enterprise SATA drives so far. Around 20% arrived bad. From SMART details it appeared most somehow got damaged during shipment though they were well packed with no signs of damage. Mostly 200 Pressure_Limit. All were tested good (short offline) by the seller before shipment, except one that obviously failed before shipment. That one's on them, fell through the cracks somehow. I will say they were very responsive and processed full refunds quickly.

Based on your comments it sounds like they currently don't have a good handle on OEM vs vender formatting, firmware, and lock-in aspects for enterprise SSDs. Anyway I'd buy more enterprise HDDs from them, but I'd hesitate to buy enterprise SSDs off them, especially if i see more feedback like yours.
 
Last edited:

kapone

Well-Known Member
May 23, 2015
2,048
1,390
113
I'm surprised it's THAT low.

It's also not about Wattage but also about which Voltage Rail they are loading. You must also check that the 5V Rail can provide enough Current, although that goes also (and more importantly) for SSDs too. Startup Transient of HDDs should only be 12V.

I just remember that I had an Issue with a low Power (440W ? 560W ? cannot remember exactly) when I had 10 or 12 HDDs in that Chassis, but with the Move I didn't even retest since :( .
Here's the spec for the HGST He8 SAS drives (which are supposedly very power hungry).

Screenshot 2025-08-17 at 3.02.50 PM.png
 

luckylinux

Well-Known Member
Mar 18, 2012
1,675
548
113
That is a Fusion IO SX350 card. It'll do >3GBps easy. Granted not as fast as the latest NVME etc, but 6.4TB for $150 or less? I'm almost tempted to buy them.

p.s. They work great even in the latest Proxmox.
Well somebody bought them. Seller rejected my Offer of 90 USD / Piece :rolleyes: .
 

Cruzader

Well-Known Member
Jan 1, 2021
980
953
93
I just remember that I had an Issue with a low Power (440W ? 560W ? cannot remember exactly) when I had 10 or 12 HDDs in that Chassis, but with the Move I didn't even retest since :( .
If its a older split rail design those can be a bit more of a pain to slit the load correctly on.
They would also trip easier than newer designs on the load spikes.

The price increase from going up in watts also used to be much lower, so going with a 1000w "just to be safe" did not come at the same premium as it does today.
 

kapone

Well-Known Member
May 23, 2015
2,048
1,390
113
Main Issue in increasing Power is the low-Load [lack of] Efficiency with the "big" Wattage PSU.
Yup. Most Supermicro PSUs > ~700w are less than 70-75% efficient when you're idling in the two digits. Even power hungry CPUs like the Ivy Bridge era, idle at less than 40w with a single CPU. Even with dual CPUs they idle ~78-80w (I've done extensive measurements over the years).

The SM "platinum" PSUs are only efficient in the 30-90% range, and generally in a homely setting, we don't drive them that way.
 
  • Like
Reactions: luckylinux

luckylinux

Well-Known Member
Mar 18, 2012
1,675
548
113
I set up the home NAS with SSDs to keep noise down (a handful of 1.92tb Samsung I got for $40 each when prices dipped). But, it was so popular with the family….its “full”. So have to get something else.
Those are some incredible Prices :oops: .

Little cooling fans on a PCIe card shouldn’t be too bad, right?
If you have the Space for it and can give up the next PCIe Slot, sure. Or centrifugal Fan. Or Side Chassis fan depending on the Chassis Model.
 
  • Like
Reactions: Markess

kapone

Well-Known Member
May 23, 2015
2,048
1,390
113
That's why I always remove the Redundant PSU and in most Cases I'm replacing the PWS-920P-SQ with the PWS-501P-1R (500W) (for those with the PDU) or similar Wattage with Cables. Still a Transition Phase though ...
Those are all of the reasons, the big guys (i.e. the hyperscalers and the likes of Oxide) don't even have individual PSUs in the systems. DC busbars are the name of the game. Way more efficient.
 

lopgok

Active Member
Aug 14, 2017
248
172
43
Yup. Most Supermicro PSUs > ~700w are less than 70-75% efficient when you're idling in the two digits. Even power hungry CPUs like the Ivy Bridge era, idle at less than 40w with a single CPU. Even with dual CPUs they idle ~78-80w (I've done extensive measurements over the years).

The SM "platinum" PSUs are only efficient in the 30-90% range, and generally in a homely setting, we don't drive them that way.
All 80+ rated power supplies need to meet their efficiency goal at 20%, except for titanium which needs to meet the goal at 10%.

See the chart at 80 PLUS certification specifications and ratings | CLEAResult

Platinum needs to be 90% efficient at 20% load.
Titanium needs to be 90% efficient at 10% load.
That is for 115v rated power supplies.
I don't have 1U or 2U servers, so I buy reasonably efficient ATX power supplies. My biggest power supply in use an a 550w platinum unit I use for my 64 core EPYC milan system.
 
  • Like
Reactions: Talyrius

luckylinux

Well-Known Member
Mar 18, 2012
1,675
548
113
Those are the exact reasons, I'm redoing my SAN nodes. Needed more flash, but was out of slots. So...



10x pci-e 3.0 x8 slots...The chassis (Chenbro NR40700) will need a bit of surgery to fit this monster, but should give me enough I/O for years to come.
Those Motherboards (Sandy/Ivy Bridge Generation) are quite cheap at least:


Well Flash is also SAS/SATA. I guess you WANTED (some at least) NVMe ;).

Of course we also need to remember that HBAs have a limited PCIe bandwidth, so if you are doing high IO Stuff you'll need several HBAs in Parallel anyways, even though 1 HBA might be able to handle all the Flash Disks Connection-wise.

For Instance the LSI 9306-24i for 24 Drives but can "only" do 64 gbps in one Direction or 128 gbps in both Directions, so above 64 gbps write / 6 gbps / drive ~ 10 SATA Drives or ~ 5 SAS Drives you will bottleneck - although I'd argue that in real Life it might NOT be such a big Problem in the End.

The Chenbro already has ~1PB of spinning rust, but more flash is needed (who doesn't need more flash!).
1PB of Spinning Rust :oops::oops::oops: ???

EDIT 1: That Chembro Chassis seems to be super-expensive and difficult to find though (it's EOL apparently).

Officially it only supports 7xPCI Slots though, so I'm curious how you are going to make that work.

Even the Fractal Define 7 XL "only" has 9 PCI Slots (plus 3 transversal ones) and supports these "big" Motherboards, so I don't think it will work in this one either:
  • E-ATX
  • EE-ATX
  • SSI-CEB
  • SSI-EEB

EDIT 2: the Xeon E5 v3/v4 Model, the Supermicro X10DRX, has 11 PCIe Slots even :oops:

EDIT 3: also the Motherboard you mentioned and the Picture shows 11 PCIe Slots. Why did you say 10x Slots, is one of them not working ?
 
Last edited:

luckylinux

Well-Known Member
Mar 18, 2012
1,675
548
113
god that would be so rad to run LLMs on.
Probably better the X10DRX at that Point, 300-350 USD instead of the 50 USD for the X9DRX, but potentially at least double the RAM and CPU Power. You'll need the GPUs anyways but I mean budget wise the increase in Motherboard Cost isn't that much when looking at the Total Cost of the System at that Point.

But ... I Googled for half an Hour but couldn't find any reasonable SSI-MEB or HPTX nowadays, there are a few Threads around, but it's about Cases that were built over a decade ago and were quite a Niche Market (i.e. low availability nowadays):
 

asgardthor

New Member
Jan 24, 2020
10
5
3
That's why I always remove the Redundant PSU and in most Cases I'm replacing the PWS-920P-SQ with the PWS-501P-1R (500W) (for those with the PDU) or similar Wattage with Cables. Still a Transition Phase though ...
This is interesting to me, I have 2x PWS-1K28P-SQ in my SuperMicro CSE 847 36 bay that idles roughly at 350 watts.
 

luckylinux

Well-Known Member
Mar 18, 2012
1,675
548
113
Nah. That's fantasy stress testing stuff. Real life...a single pcie 3.0 x8 HBA is more than enough for 24x spinning rust, even the latest ones.
I should have been more specific. 5 SAS SSDs or 10 SATA SSDs ;)

Definitively NOT spinning Rust, those I can see wiring 24 Spinning Rusts on a single HBA without sacrificing Performance.

Yup. And that's replicated (well, not all, about half to 2/3) to the other SAN node. Both are identical.
Holy ****. They must have costed a Fortune !


True. Bought three of them years back. They couldn't give them away at the time. I think it was $200/ea shipped and came with a nice motherboard.
:oops::oops::oops::oops::oops:


I don't need all 11 slots to have "openings". The Fusion IO SX350, the Adaptec HBA etc are all internal only. They just need to be secure enough in the chassis. It's only the NICs etc that need the slot openings.
Fair enough, but is there "free Space" when there are no more exposed PCIe Slots ?


o_O


It does. And they're open ended even! But...that motherboard is like $500...this was $27...less than a lunch.
Nah, 300-350 USD right now, probably down to 200-250 USD or so with some Negotiation.


No, sorry. It does have 11 slots except one of them is pcie-2.0 x4 from the PCH. I don't even look at these slots. blah...
:p

The Paradox is that Supermicro keeps using this bad Habit also in the X10 E5 v3/v4 Generation. DMI x4 2.0 when even the X11 E3 v5/v6 have DMI x4 3.0 :rolleyes: ...
 

tubeit

New Member
Aug 1, 2021
17
23
3
This is interesting to me, I have 2x PWS-1K28P-SQ in my SuperMicro CSE 847 36 bay that idles roughly at 350 watts.
I have a g292-z20 (which is a power hog), removing one of the two power supplies lets me idle at around 270W instead of 290W.
I'm quite sure that most of it is the CPU frequency/voltage being lowered by the system (I have the P-state managed by Linux, but removing the PSU changes the frequency a bit), but probably also some efficiency gain by using a single PSU.
 

nexox

Well-Known Member
May 3, 2023
2,047
1,023
113
This is interesting to me, I have 2x PWS-1K28P-SQ in my SuperMicro CSE 847 36 bay that idles roughly at 350 watts.
If you have accurate power metering at the wall (IPMI might be close enough, mine matches my meter, others don't trust theirs much) you can quickly test pulling one PSU to see how much the idle power drops from pushing the load over 20% on the remaining PSU. I personally run my 826 with one PSU pulled out a half inch so I can manually swap to it in the rare case that the primary PSU dies.
 
  • Like
Reactions: luckylinux