ES Xeon Discussion

LukeP

Member
Feb 12, 2017
175
18
18
41
If I were to build 10 Xeon ES systems for number crunching what would be the best value? Only need 8 gb ram per cpu. Was wondering if a ddr4 system would be better value with such low ram requirements.
 
Last edited:

Javik50k

Member
Oct 11, 2018
47
41
18
Here is the proof of working QLNS Xeons on SuperMicro X11DPH-i motherboard:



Bought from makimoo-uk on Ebay, he have some more, so who want the perfectly stable dual CPU workstation - you can use my advice. Remember, X11DPH is the only verified motherboard that can run these ES2 Xeons. ASUS will not work. Maybe GIGABYTE will do, but i don't have it to check. You may experience "Unknown device" in Device Manager/Processor, but this have no effect on CPU operation or performance. Be aware: NH-U14S DX-3647 coolers are a bit too big for X11DPH, use NH-U12S DX-3647 instead. Or go with water cooling.
Also, use 6 DIMMs per CPU, or memory configuration will revert to quad channel instead of six channel (i currently have 8x4GB on first CPU and 4x8GB on second, for a total of 64GB, planing to get 12x8GB in the future).
 
  • Like
Reactions: BennyT and tesla100

Oleh

New Member
i realized too late that U14S is too big for dph-i, was forced to bend heatsink a bit inside (~5mm) and mount both cpus together and also one of fans is oriented in opposite direction :) Btw what is the all cores turbo frequency on these es golds ? Did you run cinebench 15 on it ?
 

Javik50k

Member
Oct 11, 2018
47
41
18
5482 in Cinebench for now, but my memory configuration is not optimal (4 channel instead of 6). Maximum turbo is 3,5 GHz vs. 3,7 on retail, but ES2 have higher fused TDP (205W, max. for the X11DPH) and have tendency to use higher frequencies. In multi-threaded apps it is always 2,9 GHz (except for AVX512 loads). As for coolers, i simply trimmed some conflicting ribs (had to set up one fan as outtake, but that is totally ok for me, temp difference is about 5-7 degrees, never had more than 63C in Obsidian 900D under heaviest load).
 
  • Like
Reactions: Patriot and Oleh

Javik50k

Member
Oct 11, 2018
47
41
18
Here is my solution for 14-series Noctua coolers:



Maybe someone know, how to avoid "unknown device" in Device Manager/Processors? It is not affecting anything, but it's no beauty either. Also one of the PCI Express root ports is under Code 12, i think this is a port for ASPeed video and error caused by setting anything in BIOS from legacy to EFI.
 
  • Like
Reactions: tesla100

_haru

Member
Mar 24, 2018
47
6
8
17
Perth, Australia
Finally got my QL32 (A0 stepping E3-1230 v6) working in my Asus Z270-AR. All I had to do to get it running was dump the bios with a CH341A SPI flasher, open it up in Intel FIT, set the 'Reserved' value in the 'ME Kernel' section to 'Yes' and flash it back with the SPI. 100% stable so far.

CPU-Z:


Firestrike:


Cinebench: upload_2018-12-24_12-13-47.png
 
  • Like
Reactions: Zhang

BennyT

Active Member
Dec 1, 2018
103
27
28
...Be aware: NH-U14S DX-3647 coolers are a bit too big for X11DPH, use NH-U12S DX-3647 instead. Or go with water cooling....
Regarding lga3647 coolers, I went with Noctua "NH-D9 DX-3647 4U". I have X11-DPI-NT, but the socket placement is same as the DPH board. The fans are alot smaller on the nh-d9 (92mm) compared to those on the NH-U14S, and the orientation with the D9 pushes the air toward the I/O panel.. just another option incase any looking for 3647 coolers. And of course there's the supermicro cooler solutions with smaller fan, if needing even lower profile.
 
Last edited:

Mihail

New Member
Dec 4, 2017
11
2
3
30
LGA3647 Engineering samples looked nice so decided to give them a try, Xeon Gold 6138 ES QL1L paired with X11SPL-F (the motherboard came with the latest bios on arrival) and 64GB (8x8) DDR4 ECC REG 2133 in hex channel worked like a charm from the first try using a cheap Dynatron B5 cooling solution got fitted everything in a gaming ATX case and temps after two hours of prime95 are not exceeding 70C

xeon SP.jpg cachemem.png xeon sp2.jpg
 
  • Like
Reactions: LukeP and BennyT

nero243

Active Member
Oct 28, 2018
108
76
28
Yup thats looks like DDR3 for sure. But i'm not interested in a QEY8 anymore, my Epyc is running strong :D

Haven't unlocked the OC options yet but allcore turbo works currently.
Heres what i got out of it:
cinebench.jpg
Still headroom, i'm running in quadchannel, with timings all over the place and an ancient Agesa update.
 
  • Like
Reactions: RageBone and Mihail

nero243

Active Member
Oct 28, 2018
108
76
28
hi nero243, what is the motherboard and was it stress tested or something? looks nice
I'm using a Supermicro H11ssl-i, runs rocksolid like that. But i need a old Bios version or i'll get a instant crash under allcore load, might be a Agesa issue or a CPB issue with the ES. I have to do some more testing on that.
 

nero243

Active Member
Oct 28, 2018
108
76
28
whats the single core score for your setup and thermals under load ? thanks
Singlecore performance really depends on the memory interleaving settings and the core priority of the OS. Best was around 130, the multicore score drops to 3800 like that and with the multicore settings the singlecore score drops to about 110.

Unlocked software overclocking on windows today, the 2.9 GHz allcore turbo are not a limit anymore :D

Thermals are not an issue for me, i'm running custom loop watercooling with a 1080 radiator. Coretemp is reporting 27°C at idle and 56°C at prime 95 small ffts. I'd say you can add 10°C on these readings, doesn't seem realistic otherwise. VRMs are more of a problem, but i'm going to mill a waterblock when i have some more time.
 
  • Like
Reactions: RageBone

Mihail

New Member
Dec 4, 2017
11
2
3
30
this are excellent results for a cpu which cost a fraction of the retail product price , all core turbo and overclock availability is a huge bonus on top - i know that windows scheduler is a pain when it comes to so many cores :D keep it up i believe you can get more out of it :)