E5-2670 + SM Board very weird CPU Temps & Fan Speeds

[T_Minus]

Motherboard: Supermicro (ebay)
BIOS: Updated to version from I believe Jan 2015, I have it in "performance" mode too.
CPU: 2x E5-2670 v1 from ESISO on ebay


I got 14 of these CPUs from ESISO and tested all of them and all worked fine, tested in the same motherboard I'm using now FWIW, and not rolled out into production yet. Today testing my ZOL setup I noticed the 2U HSF are dead-silent, and even using 'stress' tool to put load on 16 cores they only ramped up a VERY little bit, but were pretty much still dead quiet... as-in 2' from my head I can barely tell the fans are spinning. When I set the stress tool on 16 cores and monitored 'sensors' it got up to mid 70s before I shut it down as the fans were not going any higher and the temps were climbing. As soon as I shut down 'stress' the temps dropped 10*C instantly.

The Cores idle pretty warm too mid 40*cs.

Here's an output from sensors during a stress run on 16 cores after <1m.

i350bb-pci-0500
Adapter: PCI adapter
loc1: +54.0°C (high = +120.0°C, crit = +110.0°C)

coretemp-isa-0000
Adapter: ISA adapter
Physical id 0: +71.0°C (high = +90.0°C, crit = +100.0°C)
Core 0: +69.0°C (high = +90.0°C, crit = +100.0°C)
Core 1: +68.0°C (high = +90.0°C, crit = +100.0°C)
Core 2: +63.0°C (high = +90.0°C, crit = +100.0°C)
Core 3: +67.0°C (high = +90.0°C, crit = +100.0°C)
Core 4: +68.0°C (high = +90.0°C, crit = +100.0°C)
Core 5: +69.0°C (high = +90.0°C, crit = +100.0°C)
Core 6: +71.0°C (high = +90.0°C, crit = +100.0°C)
Core 7: +68.0°C (high = +90.0°C, crit = +100.0°C)

coretemp-isa-0001
Adapter: ISA adapter
Physical id 1: +76.0°C (high = +90.0°C, crit = +100.0°C)
Core 0: +73.0°C (high = +90.0°C, crit = +100.0°C)
Core 1: +72.0°C (high = +90.0°C, crit = +100.0°C)
Core 2: +74.0°C (high = +90.0°C, crit = +100.0°C)
Core 3: +73.0°C (high = +90.0°C, crit = +100.0°C)
Core 4: +75.0°C (high = +90.0°C, crit = +100.0°C)
Core 5: +76.0°C (high = +90.0°C, crit = +100.0°C)
Core 6: +75.0°C (high = +90.0°C, crit = +100.0°C)
Core 7: +72.0°C (high = +90.0°C, crit = +100.0°C)

CPU Info during stress run
2 Octa core Intel Xeon E5-2670 0s (-HT-MCP-SMP-) cache: 40960 KB
clock speeds: max: 3300 MHz 1: 3169 MHz 2: 3161 MHz 3: 3298 MHz 4: 3199 MHz 5: 3113 MHz 6: 3199 MHz
7: 3298 MHz 8: 3199 MHz 9: 3199 MHz 10: 3199 MHz 11: 3200 MHz 12: 3116 MHz 13: 3196 MHz 14: 3199 MHz
15: 3198 MHz 16: 3198 MHz 17: 3199 MHz 18: 3198 MHz 19: 3202 MHz 20: 3046 MHz 21: 3199 MHz
22: 3046 MHz 23: 3203 MHz 24: 3152 MHz 25: 3278 MHz 26: 3239 MHz 27: 3197 MHz 28: 3174 MHz
29: 3195 MHz 30: 3137 MHz 31: 3164 MHz 32: 3199 MHz

 

[T_Minus]

BIOS & IPMI Updated to latest... fans still not ramping up and jumping to 75*C QUICK when testing 16+ cores.

 

[T_Minus]

Fan Mode was set to: Set Fan to PUE(Power Utilization Effectiveness) Optimal Speed

Which I've nEVER seen "PUE" mode!! What is that?? I've only seen OPTIMAL in taht place.

Changing to standard to see.

 

[T_Minus]

Standard mode
stress with 16 cores

69-70*C per-CPU package

seems high but maybe that's what SM has it programmed to ??

 

[T_Minus]

Shortly after posting the last message I changed it to 100% utilization via stress 32 on all 16Cores/32 w/HT and with standard mode it stayed 71-72*C and never went above, ambient room temp is 24*C, and fan speed never above 5500 RPM. I then changed IPMI Fan mode to full speed and each CPU temp package dropped to 65*C with some cores down to 60*C.

I googled PUE (and e-mailed SM) but it said that the PUE mode was for certain x10 cooling setups, and I found another Q in their FAQ stating they were going to 'rename' it on x9 boards... I'm not sure if that's a mistake and it shouldn't be an option for any x9, or if it's just a wording mistake, or what... but we'll see what SM says.

 

[T_Minus]

2U HSF on Standard Mode -- barely audible. Quieter than a room/house fan, no annoying wine.
Idle Tem: 39-42*C Ambient Room: 24*C

I'm sooo impressed with these fans. If I put it back in PUE mode it will go DEAD SILENT but temps raise 5*C or more at idle, for reference the sound level would be completely silent in a desktop style case with 120mm fans front/rear and likely remain within 2-4*C of idle temps now. I'm going to be installing a couple of these in 'desktop' style cases for friends so I'll report back, but damn these 2U HSF are amazing. (Dynatron)

 

[T_Minus]

Standard Mode: 3000 & 3200 RPM & 39-41*C Idle
PUE Mode: 1800 & 1575 RPM & 45-47*C Idle (had to let it idle a bit and raise temps from the above lower temps took a few mins but settled)
(Ambient still 24*C)

In PUE Mode my synology 5 bay with WD RE drives has louder 'air moving' sound than the 2U HSFs, the 2U HSF have a slight hummmmm no wine, but no air moving sound. Overall you could run these in the same room as you EASILY, the problem realistically is the chassis mid-plane fans on the 2U they are not quiet at all! BUT, you could def. mod them and run 2U in the same room... something I never thought possible!

 

[FozzieBear]

Which heatsink\fan are you running? I've been trying to track down one that doesn't sound like a hair dryer for awhile.

 

[T_Minus]

Dynatron 2U I have some pics and videos coming of it running. It's as heavy as a tank, rather insane. I'm not sure if the SM 2u HSF would be as quiet on PUE mode but I plan to test soon.

SM also replied to my question but they were using an IPMI firmware version that was newer than mine, yet mine was the one from their site for this board as 'latest'. My thresholds are in the 90*C-100*C his was <90* so def. something up with their firmware on the site, but nothing wrong with the CPU running >40*C or 50*C at idle if you want silent CPU Fan.

 

[g33k]

Absolutely love dynatron heatsinks. I've used their 3U heatsinks for 1155 and 2011 platform with great success. Affordable & effective, who can argue with that? Their 3U 2011 heatsink doesn't even ramp up when encoding video on my workstation with an e5-1650v2 xeon.

 

[T_Minus]

Good to know, I have the 1155 units too but haven't run them yet!

 

[FozzieBear]

You guys using the R14 or R24 for the narrow ILM sockets? Looking at the spec sheets they've got identical dBA ratings...though I'm guessing it's just for the fan, not fan + heatsink.

 

[T_Minus]

Mine are narrow.

 

[Fritz]

Mine are narrow.

Which model ?

 

[T_Minus]

R14

 

[Fritz]

Thanks

Damn, I've got a X9DRD-7LN4F-JBOD on the way and I cannot find anywhere whether it has the narrow or square mounting hole pattern.

 

[T_Minus]

@Fritz http://www.supermicro.com/manuals/brochure/x9_HeatSink_Compatibility.pdf

Narrow ILM it appears.

 

[Fritz]

Thank you sir.

How were you able to determine this?

 

[T_Minus]

Went to SM site for that board and looked.

Supermicro | Products | Motherboards | Xeon® Boards | X10DAL-i
vs
Supermicro | Products | Motherboards | Xeon® Boards | X9DRD-7LN4F-JBOD

Note how the screw holes are placed.

 

[Fritz]

Ah. It's geniuses like you that make this board great.