Enterprise SSD "small deals"

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

kapone

Well-Known Member
May 23, 2015
2,009
1,376
113
I'd probably just put the Motherboard in an Open Frame on an Acrylic Plate or something
The thing is that the 48x spinning rust will still need to be connected to it. And the Chenbro is compatible with full height cards. To split this up, it'd end up taking 8U of rack space per SAN node...
 

kapone

Well-Known Member
May 23, 2015
2,009
1,376
113
Probably better the X10DRX at that Point, 300-350 USD instead of the 50 USD for the X9DRX, but potentially at least double the RAM and CPU Power. You'll need the GPUs anyways but I mean budget wise the increase in Motherboard Cost isn't that much when looking at the Total Cost of the System at that Point.

But ... I Googled for half an Hour but couldn't find any reasonable SSI-MEB or HPTX nowadays, there are a few Threads around, but it's about Cases that were built over a decade ago and were quite a Niche Market (i.e. low availability nowadays):
The other thing about the X10 series (which I don't like) is that it's still pcie 3.0. If I'm gonna spend money to upgrade...I want better than that. My next upgrade will most likely be an Epyc based system with (hopefully) pcie 5.0 slots.

Until then...el-cheapo X9 series is it. :)
 

kapone

Well-Known Member
May 23, 2015
2,009
1,376
113
I said **I** would, also because I don't have access to that cheap Chassis :p .

That being said I definitively have more experience in NAS than SAN. The single Point of Failure of Networking (even with dual NICs, dual switches + LAGG + Spanning Tree Protocol etc) makes it highly unpractical for storing VMs over iSCSI/NVMeOF, unless it's as Part of a CEPH Cluster or similar, which typically requires more than 5-7 Nodes, preferrably Symmetric / Balanced (no BIG.little o_O).

I haven't even started with that (NVMe) so I probably have a few Concepts that are somewhat wrong.
It's really not. CEPH has its place, but an active-active SAN does make things fairly easy. I'm using Starwind SAN on these nodes (on Proxmox as the base/bare metal) and the rest of the Proxmox cluster is completely run over ISCSI (for boot and a few other things) and will run NVME-oF shortly (which is why this upgrade is taking place).

But even with that, a cluster aware file system is really not that critical in my case, because almost all compute in my application writes to the Postgres databases (and I'm moving to an active-active multi master for that as well). It's only the Postgres servers that need ultra fast, low latency disk access.
 

kapone

Well-Known Member
May 23, 2015
2,009
1,376
113
Without Cluster if your SAN goes down each and every VM on every cluster Node will crash/panic since it won't be able to write any longer, wouldn't it ?

Are you using the Free Version ?

Management via PowerShell :rolleyes: . It's true Powershell can also be run on GNU/Linux but I have a bad Feeling should I try that. I don't use Windows at Home any longer for several Years.
That's why it's active-active... :) Two SAN nodes, real-time replication between them and ISCSI multi-path. If one goes down...the cluster doesn't even hiccup.

Yes, I'm using the free version, but you're a bit behind the curve. The KVM version of Starwind SAN has no restrictions...It allows HA LUN creation via the web-gui... :) No Windows needed (although they do use wine internally in the VM...which is ...well, meh.)
 

ca3y6

Well-Known Member
Apr 3, 2021
835
819
93
Of course everything will be Network Bottleneck like crazy in my Case, 10gbps Switch is the Max I got. And 100gbps Switches are too Noisy for my House I believe ...
Where will you be consuming that storage from? Might be worth doing server to server 56gbps or 100gbps connections, all you need is 3 cards with double ports, and each server is connected to each others.
 

kapone

Well-Known Member
May 23, 2015
2,009
1,376
113
Of course everything will be Network Bottleneck like crazy in my Case, 10gbps Switch is the Max I got. And 100gbps Switches are too Noisy for my House I believe ...
Yup. A good network fabric is essential, especially if you're doing RDMA... Still cleaning up the wiring and hooking up the rest of it, but switched out the ICX 6610 (was doing a bunch of 10g ports) to a Mellanox SX6036 (36x40gbps ports, and it'll do 56gbps on each port with the right cables and NICs).



40/56g DAC cables are thick....and heavy...should have gone with AOC cables...well, maybe someday.
 

b3rrytech

Member
Dec 21, 2021
86
54
18
Sweden
Looking at the data sheet for the Micron 5210 ION they’ve pretty lousy write IOPS and write speed. Definitely a WORM drive. Endurance is a bit lower than the 5100 ECO.

I guess they were a pretty good deal new if you upgraded from HDDs and had mostly WORM data. Still, even this post might be a decent deal depending on use case.
 

josh

Active Member
Oct 21, 2013
642
212
43
But that's a great deal, and as you can tell from the timeline of the thread, it was gone in minutes. The vast majority of buyers wait to make a decision to buy, and once they do, take the first price on ebay. But opportunistic buyers like most followers of this thread, who are happy to wait for months to grab a great deal (i.e. have the patience, the funds and available slots) are atypical. And I am actually out of that population (no more available slots). In fact I have a pile of unused 3.84TB SATA SSDs waiting in a closet which breaks my heart! I have been a net seller on ebay YTD.
Where are you selling your 3.84TBs :)
 
  • Like
Reactions: richard.dzavoronok

ca3y6

Well-Known Member
Apr 3, 2021
835
819
93
Where are you selling your 3.84TBs :)
For the moment I am only selling a couple of 10DWPD 3.2TB drives:



They are good deals but not great deals!! I have a handful of 3.2TB U.2 and a big pile of 3.84TB SATA that I keep around for a hypothetical future project.
 
  • Wow
Reactions: luckylinux

josh

Active Member
Oct 21, 2013
642
212
43
For the moment I am only selling a couple of 10DWPD 3.2TB drives:



They are good deals but not great deals!! I have a handful of 3.2TB U.2 and a big pile of 3.84TB SATA that I keep around for a hypothetical future project.
Only one each? :(