Intel Xeon E5-2670 Deal and Price Tracking

[nthu9280]

Agg Thrm Mgn 2 is a Global Aggregate Thermal Margin sensor; a virtual sensor that aggregates the values from other temp sensors (...I dunno which ones specifically). I've seen the same thing when I was running ESXi and loaded the CPUs. I presume it's a discrepancy with how ESXi interprets that value vs what the Intel BMC does..

Just an observation, your CPU1 was running hotter than CPU2; I presume that your VM running mprime was only using cores from CPU1? If not, then you may have an issue with the heat sink fit on CPU1.

Jake,

I agree that there is an issue with my P1 heat sink install. See attached IPMI sensor output. This time also the BMC Web Console didn't flag "Agg Thrm Mgn 2" where as the IPMI Util output did. I ran the test with Live USB instead of VM. Even when the system is idle, P1 temp is higher.

I ran similar test on P4000L/IP4 build and its P1 is cooler as it should.

 

[jwegman]

Jake,

I agree that there is an issue with my P1 heat sink install. See attached IPMI sensor output. This time also the BMC Web Console didn't flag "Agg Thrm Mgn 2" where as the IPMI Util output did. I ran the test with Live USB instead of VM. Even when the system is idle, P1 temp is higher.

I ran similar test on P4000L/IP4 build and its P1 is cooler as it should.

Again, I don't know what sensors the "Agg Thrm Mgn 2" is aggregating; I also have the same results when loading the box with ipmiutil, but the Web BMC doesn't flag the sensor reading as critical (the web BMC doesn't have any threshold values for that virtual sensor)... Someone should ask Intel what it actually means . I don't think that I'm going to worry about it...:

george@ubuntuvm1:~$ ipmiutil sensor -c -g fan,temp,fru -N nas2-ipmi -U root -P xxxxxxx
ipmiutil ver 2.96
isensor: version 2.96
-- BMC version 1.25, IPMI version 2.0
ID  | SDRType | Type            |SNum| Name             |Status| Reading
000b | Compact | Temperature     | 0d | SSB Therm Trip   | OK   |
000d | Full    | FRU Sensor      | 11 | System Airflow   | OK   | 114.00 CFM
000f | Full    | Temperature     | 20 | BB EDGE Temp     | OK   | 26.00 C
0010 | Full    | Temperature     | 21 | Front Panel Temp | OK   | 23.00 C
0011 | Full    | Temperature     | 22 | SSB Temp         | OK   | 43.00 C
0012 | Full    | Temperature     | 23 | BB BMC Temp      | OK   | 42.00 C
0013 | Full    | Temperature     | 24 | BB P2 VR Temp    | OK   | 60.00 C
0014 | Full    | Temperature     | 25 | BB MEM VR Temp   | OK   | 43.00 C
0015 | Full    | Temperature     | 29 | HSBP 1 Temp      | OK   | 25.00 C
0016 | Full    | Temperature     | 2a | HSBP 2 Temp      | OK   | 23.00 C
0017 | Full    | Temperature     | 2f | LAN NIC Temp     | OK   | 53.00 C
0018 | Full    | Fan             | 30 | System Fan 1     | OK   | 1624.00 RPM
0019 | Full    | Fan             | 31 | System Fan 2     | OK   | 2260.00 RPM
001e | Full    | Temperature     | 74 | P1 Therm Margin  | OK   | -20.00 C
001f | Full    | Temperature     | 75 | P2 Therm Margin  | OK   | -23.00 C
0020 | Full    | Temperature     | 78 | P1 Therm Ctrl %  | OK   | 0.00 %
0021 | Full    | Temperature     | 79 | P2 Therm Ctrl %  | OK   | 0.00 %
0027 | Full    | Temperature     | 83 | P1 DTS Therm Mgn | OK   | -20.00 C
0028 | Full    | Temperature     | 84 | P2 DTS Therm Mgn | OK   | -23.00 C
002a | Compact | Temperature     | 90 | P1 VRD Hot       | OK   |
002b | Compact | Temperature     | 91 | P2 VRD Hot       | OK   |
002c | Compact | Temperature     | 94 | P1 MEM01 VRD Hot | OK   |
002d | Compact | Temperature     | 95 | P1 MEM23 VRD Hot | OK   |
002e | Compact | Temperature     | 96 | P2 MEM01 VRD Hot | OK   |
002f | Compact | Temperature     | 97 | P2 MEM23 VRD Hot | OK   |
0030 | Full    | Temperature     | b0 | DIMM Thrm Mrgn 1 | OK   | -35.00 C
0031 | Full    | Temperature     | b1 | DIMM Thrm Mrgn 2 | OK   | -41.00 C
0032 | Full    | Temperature     | b2 | DIMM Thrm Mrgn 3 | OK   | -29.00 C
0033 | Full    | Temperature     | b3 | DIMM Thrm Mrgn 4 | OK   | -32.00 C
0036 | Full    | Temperature     | c8 | Agg Thrm Mgn 1   | OK   | -24.00 C
0037 | Full    | Temperature     | c9 | Agg Thrm Mgn 2   | Crit-hi | 4.00 C
ipmiutil sensor, completed successfully

 

[SINN78]

need some help please got the following from natex
1 Intel s2600cp
and 64gb of hynix ram

got everything installed and ran memtest 4.3.7 and the thing locks up in under 2 minutes
the 2 cpus i got from esiso and had previously stress tested 1 (single cpu system)at a time using another board and totally different ram
damn what do you guys think? ram? motherboard? both?

 

[jwegman]

need some help please got the following from natex
1 Intel s2600cp
and 64gb of hynix ram

got everything installed and ran memtest 4.3.7 and the thing locks up in under 2 minutes
the 2 cpus i got from esiso and had previously stress tested 1 (single cpu system)at a time using another board and totally different ram
damn what do you guys think? ram? motherboard? both?

Make sure that you are running memtest in single cpu mode. It's notorious for freezing up when running in SMP mode.

 

[SINN78]

hmmm i just let it load the default so I'm assuming i ran it in smp mode? sadly i have to take the power supply out of my main machine to test this because my testing supply only has 1 8 pin cpu connector

 

[4004]

got everything installed and ran memtest 4.3.7 and the thing locks up in under 2 minutes

damn what do you guys think? ram? motherboard? both?

The memory controller is on the CPU die.

Try the newer version
MemTest86 - Download now!

Load BIOS defaults and/or update the BIOS.

Test single stick and with single CPU at a time.

 

[arkuatic]

Anyone got suggestion for great deals on some platter drives? Recently filled 16tb on my server and looking for at least 20TB more storage. Using raid 0 for the speed but haven't come up on any well priced drives. Possibly considering getting another pair of 2670s with a 4U purely for storage since I have been burning through TBs of data daily.

 

[4004]

Anyone got suggestion for great deals on some platter drives? Recently filled 16tb on my server and looking for at least 20TB more storage. Using raid 0 for the speed but haven't come up on any well priced drives. Possibly considering getting another pair of 2670s with a 4U purely for storage since I have been burning through TBs of data daily.

If you can trust STH, then this
Seagate 4TB 2.5" SATA drives for 61% off by shucking externals
WD My Book 8TB - 5400rpm WD80EZZX with Benchmarks

 

[JC Connell]

In what ways are you guys testing your new equipment? I just received the combo deal from Natex with the Intel S2000cp, 2x E5-2670s and 128GB of ram. I'd like to make sure everything is functional within the return window.

 

[Churchill]

In what ways are you guys testing your new equipment? I just received the combo deal from Natex with the Intel S2000cp, 2x E5-2670s and 128GB of ram. I'd like to make sure everything is functional within the return window.

Installing the equipment in a case and turning it on?

 

[JC Connell]

Installing the equipment in a case and turning it on?

I've seen some users run MemTest. I've also seen some other utilities listed that I'm not familiar with. It turns on fine... I'm just trying to prevent headaches with RAM or other components that could potentially be faulty.

 

[groundzyy]

I built a dual e5-2670 sr0kx system out of z820 parts I acquired on ebay.

Hindsight being 20/20 and now knowing about natex I wouldn't have gone this route, but after reading the techspot article I was on the hunt for a motherboard on Ebay. Without thinking, or should I saw "knowing" - that HP was just proprietary bs, I bought the motherboard NIB, reading some more about my purchase it dawned on me I'd be endlessly hacking a power supply to make it work, but then I found a cheapish (they accepted my offer) z820 case w/ 850watt powersupply also sold on ebay, so it was becoming more realistic, at least without hacking things to work. The e5-2670's I got from a chinese seller on ebay, they were legit and work no problem - shipped in toilet paper, wrapped in bubble wrap though!

the z820 usually comes with a dual rad setup, which I replaced with noctua heatsinks and fans, the ram is 64gb 1866 samsung ddr3 ecc reg ram, but runs at 1600 obviously. Because i'm not using the large plastic cpu cooling shroud, with memory fans etc - I do get some errors on startup - basically it detects that those items aren't plugged in, which it thinks is critical. The shroud (which did come with the case) obviously won't fit over the noctua heatsinks, but there would be an easy way to hack that in so it thinks it's all legit. the fan connectors are different on hps proprietary bs but you just have to file down the one middle ridge on the connector.

Otherwise it works great, I haven't found a good location for the ssd yet, so it's "sitting" in the empty bay location, while a western digital black 1tb drive is through the SAS controller in the hdd bays. I don't know if HP makes a little ssd adapter for those bays, but the 2.5" to 3.5" adapter bracket I have the ssd doesn't align it right to slide into the preinstalled sata/pwr connection at the back of each bay.... the gfx card is just an old nvidia 250 gts, works perfect for straight up rendering jobs in 3ds max/vray, which is all this rig is for. It cinebench's at exactly 2000. one processor does run 10 degree's hotter than the other, but right now in vray one is at 45 - 55 range the other 55 - 64 deg range, so not bad.

I now have a Natex board on order, also with 64gb, that I will build into a phantek enthoo pro case, with dual hyper 212 evo's.

if anyone has any questions about this setup, I'll do my best!
cheers, and thanks for all the info in this forum (even though I found it too late!)

Thanks for your sharing! I have some questions about ehe Natex bundle (motherboard, cpu*2, memory). Does it mean I can use any full tower case with E-ATX support, and any cooler for socket 2011 like hyper 212 evo you mentioned(cost 20-30 each right?). What I also need are SATA HDD/SSD, PSU (I have one SeaSonic SS-750KM3 750W ATX12V V2.3), and an optional video card (I have one PNY GTX970)? And if I am lucky enough, it should be on right?

After it is on, all I need to do is to install a OS (windows server or linux) through USB driver as what people did on desktop/laptop?

I am new to such kind of server, and new to the forum. So forgive me if I asked some silly questions.

Thanks again!

 

[arkuatic]

If you can trust STH, then this
Seagate 4TB 2.5" SATA drives for 61% off by shucking externals
WD My Book 8TB - 5400rpm WD80EZZX with Benchmarks

Been looking at some "white labels" such as : New 4TB 64MB Cache 7200RPM (Enterprise Grade) SATA 6.0Gb/s 3.5" Hard Drive

Another "used" but 4TB 64MB Cache 7200RPM (Enterprise Grade) SAS 6.0Gb/s 3.5" Hard Drive WD

Best priced for new seems to be seagate archives but it's still pretty new to judge it's reliability.

 

[ibuyufo]

I need some help from people who purchased the Intel R2312GL4GS server and the Intel RMS25KB080 raid card. For the life of me I can't figure how to access the raid card's menu to create a raid drive. I can see the card in the mass storage area when I get into bios by pressing F2, but it's not listed during post. What am I doing wrong?

 

[imchipz]

So I have found this for 105 + 7 shipping AUD on ebay from hong kong. Now the only issue is getting a motherboard shipped.

Got a quote on shipping of motherboards from the US. Nearly had a MI ... quotes from 290$ to 350$! Has there been any Aussie who's sourced a good home for these processors?

 

[Roy68]

OK I now have my S2600CP board booting into Linux 17.3, board is still on my desk awaiting fitting into case.

I did some Blender render benchmarks, great results! It's around 55% faster than my previous 2 x X5650 Xeon system, which is just about what I expected. With all CPUs nailed to 100% during renders the CPUs are still clocking 2.999GHz, I didn't expect this much Turbo with all cores at 100%.

CPU fans constantly spinning at full speed but understand I need to go through the Bios update & fan select procedure to sort this out, I'll do this once I have the board in the case (case arrived today, multiple hacks required to make it fit into Corsair Carbide Air 540, the board goes in (just!) but going to need to change front fans to 3 x 120mm instead of 2 x 140 supplied, I was going to change these anyway because the stock fans are only 3 pin. Out of the box only 2 lower left stand offs nearest PCI slots line up correctly.

A couple of questions re the fan PWM sockets on the board, these are 6 pin. My case fans will be PWM 4 pin, they will plug into the 6 pin socket no problem. BUT....this will leave two unconnected pins which Intel pinout describes as "Present" and "fault". If these pins are left unconnected is the board going to think there are faults on the fans, and spin everything at full speed? I definitely want to be able to have control of fan speed, the CPU fans constantly spinning full speed with the board sat on my desk soon become tiresome!

There is one 4 pin PWM fan connector on the board besides the CPU fan connectors - system fan 7, which I could maybe use. Has anyone tried controlling from this connector, is it true PWM?

Another option might be to get a fan hub and control everything from CPU 1 fan socket.

Board has amber flashing light and LEDs are showing fault code hex D4, I couldn't reference this code in the board spec, so I'm hoping it's just fan fault, everything else seems fine.

 

[zhoulander]

Don't worry about the 2 unused pins, not even my P4000M 2 x 120mm fans use those. I think they are utilized only with the Intel redundant fans (two fans stacked together on one connector).

Amber flashing "fault detect" indicator is because it doesn't detect fans on headers that are currently selected in the configured SDR setup, and fault mode is to pump all fans to 100%.

Run your UpdateFRUSDR, select "OTHER" case, then manually select all the fan headers that you have fans connected to. Your ears will thank you for it.

 

[Roy68]

One more question, since these 2670s still clock at 3GHz during renders with all cores 100% (for 30 min), why doesn't Intel describe them as 3GHz CPUs? Under what stress situation would the clock drop to the rated 2,6GHz? Thanks!

 

[Roy68]

Don't worry about the 2 unused pins, not even my P4000M 2 x 120mm fans use those. I think they are utilized only with the Intel redundant fans (two fans stacked together on one connector).

Amber flashing "fault detect" indicator is because it doesn't detect fans on headers that are currently selected in the configured SDR setup, and fault mode is to pump all fans to 100%.

Run your UpdateFRUSDR, select "OTHER" case, then manually select all the fan headers that you have fans connected to. Your ears will thank you for it.

Thank you sir, that's exactly what I needed to know!

 

[nthu9280]

I've seen some users run MemTest. I've also seen some other utilities listed that I'm not familiar with. It turns on fine... I'm just trying to prevent headaches with RAM or other components that could potentially be faulty.

I'm no expert but check on Intel downloads for this board for Platform Confidence Test (PCT). That runs basic diags.
Use Google to find prime95 and memtest86 for more burn in testing on CPU and RAM

Sent from my Nexus 6 using Tapatalk