Recent content by fragar

Thanks. Sounds like I'll need to verify this at every data center. Servergarden in their first email to me wrote "- we can serve performance exceeding 10kW/ rack" and later clarified that they "guaranteed" 10 kW. Now I understand why they worded it that way. Good point about the power...

Thanks. Do you mean that if all of my servers are the same, then with 3 phases it would be best to have the number of servers in a rack be a multiple of 3? Or is there some other way to balance the load between the 3 phases? And yes, if I want to sacrifice redundancy to double the power draw...

Ok, so I'd have to hook up half the servers in each rack to one redundant power source and the other half to the other source, effectively giving up redundancy. My power consumption is extremely steady. I just watched my GPU power consumption via nvidia-smi for a few minutes and it fluctuated...

I am not sure about the power specs but 3*16A * 220V would be 10.56 kW. Budapest seems to have mostly 3 kW racks, a few facilities which go to 6 kW/rack, and two facilities which go to 10 kW/rack, at least from what is publicly available. Maybe I'm missing something. Here is the page for...

Servergarden.hu got back to me about pulling more than 10 kW from a 10 kW rack with a non-committal answer: each rack is guaranteed to get 10 kW, and "in practice" the maximum "might be 10 kW". This data center only offers 10 kW racks and claims to be the densest in Budapest. Each rack gets...

Makes sense, I'll ask. The cooling capacity is probably a lot more flexible than the power. Would it make sense to hook up the two redundant power supplies on each server to the two different redundant power sources from the data center, so that when one of those two data center power sources...

The data center I'm talking to now (servergarden) specifies their 10 kW racks as "redundant power (2x)3x16A", which is more than 20 kW when both redundant halves are working. I wonder if it's possible to run the servers in that rack at the full 20 kW, and when one of the redundant halves goes...

That's pretty cool, it's a 280 Watt CPU in 2u at 50 db. It's for CPU-centric workloads though.

Stuffing a 3970x into 2u seems pretty crazy, that's a 280 Watt CPU. How much is that builder charging? For your use case GPU underclocking might not be so clear, you'll need to run the numbers. Underclocking makes more sense when your workload is steady. For example, if you run a 2080 Ti at...

Interesting. My workload also has a CPU component, Threadripper would make sense for me as well but I want IPMI and no sTRX4 boards currently support it. Also, Epycs are basically underclocked Threadrippers and that might not be such a bad thing (see below). I will be ordering my first system...

Does this mean that it's possible to negotiate 50% off? It seems to me that every data center is optimized for a certain density. TTC Teleport is optimized for 6 kw racks (but offers 10 kW racks at the same price per kW for people who really insist on that). Verne Global and servergarden.hu are...

One more question: are there any other cheap "direct power" services out there which have a lower minimum kW than the 90 kW minimum of Verne Global? Is it possible to rent a single 10 kW rack somewhere without UPS for significantly less than €160/kW/month?

Thanks. That all makes sense. Verne Global lets you ship your equipment directly to them from the vendor and will hold it for you for free in a secure bay. Traveling there once every year or two would be no big deal. 6 kW cabinets make sense when they're available. TTC Teleport offers a 6 kW...

I posted some questions about colocating these servers here: https://forums.servethehome.com/index.php?threads/questions-about-colocating.28557/ It seems that 10kW per rack is kind of a sweet spot, only a few data centers offer more than that and those services aren't any cheaper per kW. Four...

I am looking for a colocation facility and have a few questions. Background and requirements: 1. This will be my first time colocating. 2. I need a rack of around 10 kW, which I will fill with 4u 1 kW inference servers (hardware discussion here...