Potential Deal: 2 x Dual 2011 nodes @$199, Quanta Openrack

[grfxlab]

For anyone looking for basic risers... I also needed a riser to add a graphics card to the quanta nodes. I went with "PCI-E Express 16X 90 Degree Adapter Riser Card For 2U Computer Server Chassis" off of ebay. They were $3.57 each. They are only one slot and are not an exact match in height but still work for what I needed. I also added a Quadro NVS290 graphics card. These are heatsink only cards and are officially supported in Windows10. You can find them on ebay for $40 for 10 cards plus $20 in shipping. So 20 graphics cards cost only $100. these have a dms59 connector so you will need a converter cable if you don't already have one.

For the fans, what I read is the fans are set in the bios to run at the slowest speed to prevent thermal throttling.

Memory- I have tested Samsung M393B1K70DH0-YH9 8GB PC3l-10600r ECC 1.35v, Hynix HMT31GR7BFR4C-H9 PC3-10600R ECC 8GB 1.5v, Gskill F3-12800CL9-4GBRL 1.5v, Gskill F3-1600C10-8GAO 1.5v. All work without problems.

If you just need a barebones server, these are great systems.

 

[ArcyneTheFirst]

My box came in the first configuration, 10gig card no riser. After the thread I emailed the seller esisoinc and they said they would ship me the missing risers. Haven't gotten them yet but thought that I would report that they seemed open to making it right for me.

Sent from my Nexus 6 using Tapatalk

Just a follow up for the thread, I received the risers and they work well. (the part # mentioned in another message. e.g. riser with 2x slots.)

Sent from my Nexus 6 using Tapatalk

 

[yago]

I got the $199 version from esioinc and received PCIe risers, disk trays, BIOS battery but no heatsinks and no air shroud.
Does anyone have part numbers for those heatsinks?
Or can I use standard ones like this?

 

[Chris Cooper]

Has anyone tested 16gb memory modules? I have not done it yet but am considering a dual node with (Per node):
- 2 2670 CPUs
- 8 16gb ddr3 reg ecc for 256gb
- pcie riser
- Intel dual port tengb nic 520 da2
- Intel 750 1.2TB ssd
- hp power supply modification

I am thinking this would allow one host to be primary and use Veeam nfr for replication to the second node and automated failover for maintenance. Potentially a drag ate 8TB smr drive connected to the main board for slower large storage.

Any ideas or input would be great.

 

[Awesomesauce]

I got the $199 version from esioinc and received PCIe risers, disk trays, BIOS battery but no heatsinks and no air shroud.
Does anyone have part numbers for those heatsinks?
Or can I use standard ones like this?

Thats terrible, why dont you contact them and ask them to ship you the missing parts?

 

[Chris Cooper]

For my config i mean to say one shelf with both nodes operating. I plan to also use a usb header on the board for the esxi host os, the intel 750 and any sata drives would be storage for vmware guests. And lastly, a great test platform in the garage

 

[aquarapid]

RE fitting into a standard 19 inch rack:

I have decided to go old-skool and just cut off a few inches of the disk/PSU bay using an angle grinder to reduce the width of the chassis to 17 inches. It is then able to fit into a 4 post 19 inch rack with a full depth shelf. I am planning to stack them 5 high, with a separate rear-mounted short-depth shelf in-between containing the common rail HP power supplies (5 will fit side-by-side on a 1U shelf). I will then route power from each of the PSUs to the power distribution board on each server (taking care to use thick enough wire, since the 12V supply cable length will be up to a couple of feet). It is unfortunate that the HP common rail power supplies are > 3 inches wide, otherwise I could have fit them into the remnants of the right-hand-side bay.

Obviously I will "lose" the disk bays, but there will be enough space left in the right-hand-side bay (about 3 inches) to attach some 2.5 inch SSDs with velcro or double-sided tape. I might also just go for a central iSCSI storage server and toss idea of local disks. BTW, I never realized until I started measuring for this exercise that a 2.5 inch disk is actually 2.75 inches wide...

 

[StammesOpfer]

My plan in to put it on a shelf and load it from the side of my 4 post rack. The 19" actual width still fits between the vertical posts just not at the very front and back where the holes are.

 

[tbkdan]

Has anyone tested 16gb memory modules? I have not done it yet but am considering a dual node with (Per node):
- 2 2670 CPUs
- 8 16gb ddr3 reg ecc for 256gb
- pcie riser
- Intel dual port tengb nic 520 da2
- Intel 750 1.2TB ssd
- hp power supply modification

I am thinking this would allow one host to be primary and use Veeam nfr for replication to the second node and automated failover for maintenance. Potentially a drag ate 8TB smr drive connected to the main board for slower large storage.

Any ideas or input would be great.

If you want to keep a PCIe slot open, you could get a 10Gb card on the mezzanine slot. For the OCP project there's definitely a bunch made by Mellanox, but Intel makes them too.

 

[tbkdan]

I got the $199 version from esioinc and received PCIe risers, disk trays, BIOS battery but no heatsinks and no air shroud.
Does anyone have part numbers for those heatsinks?
Or can I use standard ones like this?

Mine had part number dtafbf03028010130819 rev 3b which doesn't yield any Google results =\

 

[yago]

Don't know the part numbers, but for the heatsink any LGA2011 compatible ones should work. The Supermicro ones are really well made, look for it.

Thanks, I think the Supermicro SNK-P0047PS should work, or am I missing something?

Thats terrible, why dont you contact them and ask them to ship you the missing parts?

They refuse to ship the missing parts.
But to be fair, they weren't on the picture and not in the description.

 

[Awesomesauce]

Thanks, I think the Supermicro SNK-P0047PS should work, or am I missing something?



They refuse to ship the missing parts.
But to be fair, they weren't on the picture and not in the description.

I messaged them to confirm and they said yes those are included.

 

[grfxlab]

My plan in to put it on a shelf and load it from the side of my 4 post rack. The 19" actual width still fits between the vertical posts just not at the very front and back where the holes are.

Great Idea. Measured Mine and same holds true. As long as you have over 24" front to back between the rails it fits, added bonus is we can still mount 19" support equipment like PDU or 10GB switch. Thanks for sharing.

 

[ax206geek]

My Quanta Windmill and 2x E5-2670 and 64GB memory finally came. But I have 2 problems. Can't seem to get USB booting from either ports. And the fan will go into "Jet Engine" mode and make enough noise to drive me crazy after a few minutes. There's nothing in the BIOS to check temperatures and I cannot boot into any OS to check temperatures!

What could have gone wrong?

 

[LastKookie]

My Quanta Windmill and 2x E5-2670 and 64GB memory finally came. But I have 2 problems. Can't seem to get USB booting from either ports. And the fan will go into "Jet Engine" mode and make enough noise to drive me crazy after a few minutes. There's nothing in the BIOS to check temperatures and I cannot boot into any OS to check temperatures!

What could have gone wrong?

did you have the shroud on? you need it to help with cooling. if you don't just use a card board to cover the top should work as well

 

[ax206geek]

did you have the shroud on? you need it to help with cooling. if you don't just use a card board to cover the top should work as well

I removed shroud for OS installation temporarily to let the graphics card fit into the pcie slot. Will put it back when OS is installed.

 

[LastKookie]

I removed shroud for OS installation temporarily to let the graphics card fit into the pcie slot. Will put it back when OS is installed.

that's probably why your fan was going nuts. you need to shroud to keep both cpu cool

 

[Mehmet]

Has anyone cracked how to use DCMI for remote management on these servers? Any recommendations on client tools? Does ipmi-dcmi work?

Follow the link but only works on centos 6.7

Bug #1156667 “Need driver support for IPMI device on OCPv2 Windm...” : Bugs : The Open Compute Project

Tried but could not succeed on centos 7.

I think it will work some other debians or ubuntus

No idea about windows

 

[smithse79]

My Quanta Windmill and 2x E5-2670 and 64GB memory finally came. But I have 2 problems. Can't seem to get USB booting from either ports. And the fan will go into "Jet Engine" mode and make enough noise to drive me crazy after a few minutes. There's nothing in the BIOS to check temperatures and I cannot boot into any OS to check temperatures!

What could have gone wrong?

Go into the BIOS, you have to enable booting from the USB. Mine came with that option turned off. If you have trouble, let me know, I can look at where it is tonight maybe.

 

[tbkdan]

that's probably why your fan was going nuts. you need to shroud to keep both cpu cool

I have mine fully covered by a box to ensure good airflow. Had it off for many hours, turned it on and it immediately goes into full speed fans (just shy of 17,000RPM) and IPMI doesn't indicate any issues (see below, the CPU0 TjMax is at 90C as soon as I hit power when cold, so I think that is literally just the max it's allowed to be..??). I only have one CPU installed right now, so I'm not sure if that's related. Installing Ubuntu 16.04 via SoL (ttyS4) as I type this (with earmuffs on...) and hoping the OS has some sane fan management or additional info I can glean to figure out what's up. Full BIOS reset (via jumper) brought it down to maybe 50% fan for a few minutes, then it ramped back up to 100%; messing with thermal and power management settings in BIOS also has no impact.

# ipmitool -I lanplus -U USERID -P PASSW0RD -H 192.168.0.91 sdr
Outlet Cntr Temp | 17 degrees C | ok
Inlet Temp | 17 degrees C | ok
PCH Temp | 43 % degrees C | ok
P0 Therm Margin | -50 degrees C | ok
P1 Therm Margin | no reading | ns
P0 DIMM Temp | no reading | ns
P1 DIMM Temp | no reading | ns
HSC0 Input Power | 68 Watts | ok
HSC0 Input Volt | 12.28 Volts | ok
CPU0 Tjmax | 90 degrees C | ok
CPU1 Tjmax | no reading | ns
SYS_Fan0 | 17040 RPM | ok
SYS_Fan1 | 16756 RPM | ok
TSOD SMBus Sts | 0xe8 | ok
CPU Therm Trip | 0x36 | ok
Pwr Thresh Evt | 0xfb | ok
Battery Mon | 0xe1 | ok
SEL Status | 0xb7 | ok
DCMI Watchdog | 0xa6 | ok
Processor Fail | 0x91 | ok
Chassis Pwr Sts | 0x76 | ok
Thermal Limit 1 | Not Readable | ns

Go into the BIOS, you have to enable booting from the USB. Mine came with that option turned off. If you have trouble, let me know, I can look at where it is tonight maybe.

Mine also had the internal USB port completely disabled by default.