Hello! Could you please tell me what you did to make it consume so much power? My entire system consumes no more than 450W under load, while it should consume 800W.
ES Xeon Discussion
- Thread starter britinpdx
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
you need to disable limits. core enhancement etc. called overclocking.
can you provide HWinfo report of that cpu ?
Can anyone suggest an ES CPU with highest AMX int8 TOPS performance? Is it just more cores = more int8 MACs regardless of stepping or family? I saw Q415 on ebay but its $2400 and I don't know what motherboard would support it (LGA7529). Should I just go with 2x Q2SR? Will be using it for LLM inference.
Also curious if anyone was able to get MRDIMMs working on granite rapids ES. Thanks
Also curious if anyone was able to get MRDIMMs working on granite rapids ES. Thanks
Last edited:
more cores, higher clocks (TDP)
gigabyte MA34-CP0
( supermicro 4710/7529 do not support ES )
I wonder if the GNR-WS ES would be better for AMX-heavy load in the end? You can get dual-CPU server board and two 86 core server CPUs, but at the same time you will have all the problems of cross-CPU communication.
OCed processor is always get in bad efficiency area.
i think same if all cores of a dual socket system has to work with same data.
The MA34-CP0 is a pretty sweet board, but those LGA 7529 Xeon 6's are power hungry. My 6960P is a 500W TDP chip. Also, the only reasonable air cooler I found for them is Dynatron C3 which is a loud 3U thing. Or go custom liquid cooling route with this Bykski water block.
SilverStone XED120S WS can cool better but classified as 450W.
so don't trust TDP values of vendors.
all LGA4710 AIO watercooler can handle 500W.
attention if you run a EPYC 500W, AMDs TDP is only the cores, you have calc with PPT value instead.
The LGA 4710 Granite Rapids have a few options especially since the coolers are compatible with LGA 4677. There are not that many options for the LGA 7529 Granite Rapids. Dynatron makes a 2U and 1U AIO as well but I'm not sure if they actually do 500W. There's this AIO but I don't know who actually makes it.
Dynatron L37 - MAXIMUM POWER 500 W
Dynatron L38 - MAXIMUM POWER 700 W
Last edited:
Damn 500W for 72 cores? Hope the clocks are high at least.
I'm considering adding a couple Gaudi 2s with the Xeons because they are super cheap on ebay for the matrix performance (AMX doesn't come close yet). But I will say Intel is making some big moves in that area especially with Crescent Island.
I'm considering adding a couple Gaudi 2s with the Xeons because they are super cheap on ebay for the matrix performance (AMX doesn't come close yet). But I will say Intel is making some big moves in that area especially with Crescent Island.
I thought the Dynatron C3 cooler was loud, I wonder how loud a couple of Gaudi 2's and their associated server infrastructure will be assuming power can be figured out! Definitely needs a proper data center, my garage won't cut it
Call me crazy but I'm going to try to cold-plate it...I thought the Dynatron C3 cooler was loud, I wonder how loud a couple of Gaudi 2's and their associated server infrastructure will be assuming power can be figured out! Definitely needs a proper data center, my garage won't cut it
Regarding power, you can PL them, not too much info about performance but I bet it will still knock out the Xeon AMX.
That's an ambitious project! If you do go down that path I'd love to read more about it in these forums.
Hi!
Has anyone tried running SPR ES processors on HPE servers ?
I have a hpe proliant dl380 gen11,Can I let it run QYFS(stepping 3,D0) by adding microcode(LIKE 06F3)?Or, does adding ES CPU support depend not only on the microcode but also on the CPLD and BMC firmware??I don't know much about it.
However, its BIOS is not AMI-based but HPE-customized, and I don't even know how to modify its microcode (mmtool doesn't work).
Maybe I shuold look for early/test version BIOS ,but HPE website does not provide this. Can anyone give some advice?
(Sorry, I'm not a native English speaker, so I used Google Translate.)
Has anyone tried running SPR ES processors on HPE servers ?
I have a hpe proliant dl380 gen11,Can I let it run QYFS(stepping 3,D0) by adding microcode(LIKE 06F3)?Or, does adding ES CPU support depend not only on the microcode but also on the CPLD and BMC firmware??I don't know much about it.
However, its BIOS is not AMI-based but HPE-customized, and I don't even know how to modify its microcode (mmtool doesn't work).
Maybe I shuold look for early/test version BIOS ,but HPE website does not provide this. Can anyone give some advice?
(Sorry, I'm not a native English speaker, so I used Google Translate.)
yes with early Test/Debug BIOS (not official, i have never seen for DL)
should work if you can.
BIOS is digitaly signed,any modfification needs a re-sign by HPE
BIOS.signed.flash is encrypted, not raw binary data.
You need a dump from BIOS chip(e.g. with ch341a and test clip) and HOPE BIOS is not BIOS Guard protected.
Last edited: