Enterprise SSD "small deals"

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

kapone

Well-Known Member
May 23, 2015
2,006
1,364
113
Yeah, but unfortunately you know ... Priorities :rolleyes: .


That's somewhat of an off Choice (IMHO). I'm mostly using Debian, Proxmox VE and Fedora (the latter for Podman Containers). I gave a very short try to Alpine/Almalinux/OpenSUSE as Container Hosts but quickly gave up on them.

I still also need to put the 24x AMD Ryxen 3500X/3600X Systems into Operation. Funnily enough I was thinking of buying some SSDs but then the Prices started Skyrocketing (it was a while back, I know). So I guess I'll need to settle to some 1 x 128GB or 2x128GB NVMe Drive or something low-cost like that :rolleyes:.
Container host...that's the difference. I thought we were talking about a storage server? i.e. You want to use Starwind for a container host?

I'm using Proxmox as well, for the container host side, but the storage is separate, connected under the hood with NFS over RDMA, and then to Proxmox, it's just a Directory.
 

kapone

Well-Known Member
May 23, 2015
2,006
1,364
113
This reminds me of the first clusters i built that just used 1meter long threaded rods through all the mobo screwholes and nuts to lock them in place.
Was oh so fun when needing to remove a mobo half.

Then moved onto something closer to your shelf with screwing it all onto plates, slightly less wobbly.
This actually worked out quite well. Part of my problem was noise and cooling, and to a lesser degree, finding the right chassis for a varied configuration of motherboards, serving different purposes.

In the end, I separated compute and storage. That left rack is ALL storage...like ~200 LFF bays worth.



The right rack is all compute, with those sleds. That right rack has six 14 inch fans cooling it, and these are pretty quiet. Not like "silent" (the amount of airflow itself makes a fair amount of noise), but given the size of the fans, it's a low frequency "hum", rather than screaming fans.



(Excuse the mess in the picture, was still in the building stage).

Now, everything is on a 56gb backbone...and life is...good. :)
 

luckylinux

Well-Known Member
Mar 18, 2012
1,626
526
113
Container host...that's the difference. I thought we were talking about a storage server? i.e. You want to use Starwind for a container host?
Yes :) .

My Point was actually that I wanted to avoid having way too many Types of Systems/Distributions to maintain.

And while you can argue that Almalinux should be quite similar to Fedora (just like Debian/Ubuntu/Proxmox VE are basically "the same Thing"), the Reality is a bit different and each gets a few different "Features" that requires special Handling :p.
 

kapone

Well-Known Member
May 23, 2015
2,006
1,364
113
My Point was actually that I wanted to avoid having way too many Types of Systems/Distributions to maintain.
Agreed, that's just a pain.

And while you can argue that Almalinux should be quite similar to Fedora
No. "RHEL", not Fedora. Yes, I know the differences (and similarities) between them. Almalinux is essentially identical to RHEL, without the licensing. Yes, there's a few minor differences, but they really are minor.

My reason for choosing Almalinux at home? I foresee moving to RHEL for my prod side, and pay for support. This way both environments are identical. My compute needs, apart from a couple of Proxmox servers running various containers and VMs, are essentially running a monolithic app on each Linux server. This app is my own code and part of my business.
 
  • Like
Reactions: luckylinux

Cruzader

Well-Known Member
Jan 1, 2021
968
963
93
Im also on Alma since that is what i use at work.

My impression is that alma "won" the enterprise side not paying for RHEL when centos as we knew it died and there was the alma or rocky decision on who to go with now.
 
Last edited:

Greg_E

Active Member
Oct 10, 2024
502
164
43
Not sure I would move to paid RHEL when I could pay for Alma support. I'm moving some things over to openSuse now as I'm learning other things that have Suse as a base. Alma would be next if I had to move and Debian is still mostly what I use for real things.
 

Greg_E

Active Member
Oct 10, 2024
502
164
43
Openshift...
So Harvester and Rancher that's a little more mature. Harvester is moving fast, good and bad things about this. Will be nice when it just merges both parts to make life easier, but I'm guessing sales got in the way and forces them to remain distinct products. Harvester already has a bunch of Rancher stuff in it, seems like it shouldn't be hard to put the rest in place and be done. It will require a more stout host to run it all, but in most of the industry, this should be a problem.
 

Filez

Active Member
Feb 18, 2019
122
99
28
Get it done my man! I know it's a slog...lots of F-bombs and "ahhh screw it, I'll do it tomorrow" type of reactions, but once done, it's...glorius.



Two racks...lost of cursing while getting them completed. Here's a funny story. In the compute rack (right rack in the picture above), I thought I had "finalized" my hardware config, built the sleds, mounted them in the rack, was gonna use iSCSI boot for everything (which did work as such), but...due to many different things, plans changed...

I ordered a whole bunch of those adapters that can hold one m.2 sata SSD and one NVME, so I can have SATA boot and one NVME in each sled. Then...had to unmount ALL of the sleds...one by one...add the adapter with SSD and sata cable...mount the sled back...





And there's a shit load of them...fun fun fun...


I've given up on Starwind. I realized I didn't really need high availability per se, a 15 minute rsync is more than enough to give me the data security I need (This is a mirror of my prod, so the data is already duplicated per se). So, once that requirement went away, I realized, well, why Starwind?

And it still doesn't do NVME-oF with HA, actually even without HA as well, still is stuck on the 20.04 kernel...no feature parity between different flavors (bare metal vs Proxmox VM vs Windows VM vs ...).

Moved to Truenas and it seemed to fit the bill...but then their RDMA restrictions kicked in...and the frustration began anew...

Been testing RHEL (specifically Almalinux) with Cockpit and surprisingly it works great! The installer is flawless, configuration is straightforward, the documentation is top notch, every flavor of RDMA under the sun, NVME-oF works OOTB... :) I might stick with this, once I've put everything through its paces.
Thats a cool rack. Do you have more pictures?
 

lopgok

Active Member
Aug 14, 2017
246
172
43

MZ-ILS15T0 Samsung PM1633a 15.36TB SAS 12Gbps 2.5in SSD EMC 118000556 - new $398 - zero feedback seller
 

ano

Well-Known Member
Nov 7, 2022
777
336
63
I recently got money back from a scam seller, it took 3 months hammering ebay/paypal

kinda weird, seller never even bother giving me a shipping nr and never answerd after initial payment
 

int0x2e

Active Member
Dec 9, 2015
160
124
43
46
I recently got money back from a scam seller, it took 3 months hammering ebay/paypal

kinda weird, seller never even bother giving me a shipping nr and never answerd after initial payment
It's become a lot more common. The sellers will either use a tracking number for somewhere close to you that they acquire somehow, or give you a long story about shipping via HK or somewhere and that you will receive another tracking number later.
I both cases, it seems like they try to get you to wait long enough for funds to be released. I assume it works out some times since these are becoming quite common...
 
  • Like
Reactions: MSameer

neobenedict

Member
Oct 2, 2020
76
34
18
  • Like
Reactions: pixelBit