@virtualfng @MiniKnight @whitey @wildchild Thanks guys. This was a lot of time (and certainly money) invested and I'm really happy to say that it really paid off. Lots more fun to have with this setup in the near future.
FINAL Bachelor Build - Xeon D vSAN Cluster
- Thread starter IamSpartacus
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
Care to share some power numbers @IamSpartacus ? - would be interesting to see the units load and combined in usage/idle/fullthrottle
At the moment the only numbers I have to go off of is what my UPS is reporting for usage. Everything in the entire rack (including 6 cabinet intake/exhaust fans) is connected to it. With the cluster basically idle I'm puling around 250w and with high usage it's in the 360-380w range.
I'm not unhappy about these numbers at all considering all the gear I have running in this rack. One of these days I will spend an hour or so turning on the entire rack from scratch device by device and measure the startup power draw and idle power draw of each unit.
Grats on the build!
It seems this is your "Lab/Home" setup so here is a friendly suggestion that may save you from wifey troubles in the future. (I've had far too many..haha).
Purchase another low power firewall (edgerouter/SG-2220) or repurpose for your main home network then virtualize pfSense for your lab and expose services via virtual IPs. You get the safety knowing if you muck up on switch configs, etc that others still have access to the internet/other devices.
Just a thought!
Have fun!
It seems this is your "Lab/Home" setup so here is a friendly suggestion that may save you from wifey troubles in the future. (I've had far too many..haha).
Purchase another low power firewall (edgerouter/SG-2220) or repurpose for your main home network then virtualize pfSense for your lab and expose services via virtual IPs. You get the safety knowing if you muck up on switch configs, etc that others still have access to the internet/other devices.
Just a thought!
Have fun!
Sorry for bringing this thread up. I was searching for a 2U rack fan and saw your rack with it (AC Infinity) before so I read it up again. I just purchased the same model from ebay, hopefully it's good. It looks nice too.
Anyways, congrats on your build, it is a really really great rack. I love it. Just one thing I noticed is that one of your 2U server's psu vent is blocked by the identical 2U server sitting on top of it. I guess this is one of the reasons why you were having trouble with your Xeon D temps?
Anyways, congrats on your build, it is a really really great rack. I love it. Just one thing I noticed is that one of your 2U server's psu vent is blocked by the identical 2U server sitting on top of it. I guess this is one of the reasons why you were having trouble with your Xeon D temps?
Sorry for bringing this thread up. I was searching for a 2U rack fan and saw your rack with it (AC Infinity) before so I read it up again. I just purchased the same model from ebay, hopefully it's good. It looks nice too.
Anyways, congrats on your build, it is a really really great rack. I love it. Just one thing I noticed is that one of your 2U server's psu vent is blocked by the identical 2U server sitting on top of it. I guess this is one of the reasons why you were having trouble with your Xeon D temps?
No need to apologize, I'm happy to answer any questions.
Yes technically the PSU vent is blocked but the PSU fan only kicks on if the PSU gets to a certain workload which is almost never will with my build. They are 360w PSU's and these servers aren't even capable of pulling 100w total on full load with everything running.
The temp issues were related to not having direct air flow over the Xeon D heatsinks which appears to be of huge importance for these boards. I remedied that with a duct from one of the 80mm intake fans directly to the heatsink and a 60mm Notctua directly behind it to pull the air through.
It's in my open door office which is right off of my living room. So the rack is about 15 feet from where I sit watching TV and I can't hear it from there. As for actual measurements I don't really have any equipment that would actually measure that.
Nice build. As for measuring equipment, I use this SPL meter to measure how loud my workstation area is in our data center: Galaxy CM-130
It can do a running measure of SPL and a maximum measured level.
For those interested, the loudest measurement for me was about 87DB
It can do a running measure of SPL and a maximum measured level.
For those interested, the loudest measurement for me was about 87DB
I've followed your build from *several* different sources and I'm curious about two things
- The rack -- can you take it apart?
- Is the iStarUSA M-4160-ATX really worth it? It seems very pricey but I need ultra-quiet ATX power supplies!
Could I take apart the cabinet and reassemble it inside the closet? I think I'd rather do that than destroy the trim/door frame.
For the record, I am married and my wife approves of this "cleanup" effort because the closet is a mess of wires and hardware right now
.
1. I don't believe you can take the rack completely apart though I haven't tried. I would visit the manufacturer's website from the link in my OP. I chatted with them online before making my purchase and they were super helpful. They'll be able to answer any questions you might have.I've followed your build from *several* different sources and I'm curious about two things
I have a wiring closet that is connected to a guest bedroom. The door frame is 24" at its narrowest point but the closet itself is 40" wide. Every coax/speaker/ethernet cable in my house terminates to this closet.
- The rack -- can you take it apart?
- Is the iStarUSA M-4160-ATX really worth it? It seems very pricey but I need ultra-quiet ATX power supplies!
Could I take apart the cabinet and reassemble it inside the closet? I think I'd rather do that than destroy the trim/door frame.
For the record, I am married and my wife approves of this "cleanup" effort because the closet is a mess of wires and hardware right now
2. With regard to the M-4160-ATX, I really like it. The trayless drive bays is a huge feature for me. I wanted to super quiet PSU's as well but keep in mind that the included system fans are not PWM and they run at full speed without a fan controller. They aren't super loud but they're not super quiet either.
Glad you've got wife approval, you're already ahead of the game!
Great configuration. Congratulation!
I have 3 questions to you.
You are using Xeon D-1508 and Xeon D-1518 as your storage nodes.
1) Do you see any benefit from 1518?
2) How do you think, is 1508 powerful enough to handle storage (12x8TB) with ZFS (FreeNAS) + 10Gbit?
3) How do you rate 10Gbit speeds on 1508 platform? Are they close to the max?
I have 3 questions to you.
You are using Xeon D-1508 and Xeon D-1518 as your storage nodes.
1) Do you see any benefit from 1518?
2) How do you think, is 1508 powerful enough to handle storage (12x8TB) with ZFS (FreeNAS) + 10Gbit?
3) How do you rate 10Gbit speeds on 1508 platform? Are they close to the max?
My 27u is in!
I have more questions about that case -- have you considered using 2.5" SSDs in any of those trayless slots? I'm trying to decide between the 3U and 4U case; with 4Us, I could devote a bank to SSDs for slog duties or whatever. I couldn't find any information on whether or not this was possible.
Thanks again!