AMD EPYC 7V13 64 core 128 thread $699

[izx]

This ES CPU with CPUID 00A00F10 should work on the SM H12SSL series with the latest BIOS 2.8 (February 2024).

Here are some topline theoretical numbers, courtesy HWInfo:

Processor Name: AMD Eng Sample: 100-000000425_37/24_N
Original Processor Frequency: 2450.0 MHz

CPU ID: 00A00F10
Extended CPU ID: 00A00F10
CPU Brand Name: AMD Eng Sample: 100-000000425_37/24_N
CPU Vendor: AuthenticAMD
CPU Stepping: GN-B0
CPU Code Name: Genesis/Milan
CPU Technology: 7 nm
CPU OPN: 100-000000425_37/24_N
CPU Thermal Design Power (TDP): 240.0 W
CPU Thermal Design Current (TDC): Fused: 215.0 A, Limit: 215.0 A
CPU Electrical Design Current (EDC): Fused: 255.0 A, Limit: 255.0 A
CPU Package Power Tracking (PPT): Fused: 240.0 W, Limit: 240.0 W
CPU Max. Junction Temperature (Tj,max): 95 °C
CPU PBO Scalar (Reliability Reduction): 1.00x
CPU Thermal Trip Limit: 115.0 °C
CPU HTC Temperature Limit: 105.0 °C
CPU Type: Engineering Sample
CPU Platform: SP3
Microcode Update Revision: A001058
SMU Firmware Revision: 45.93.0
cLDO VDDP: 0.9002 V
cLDO VDDG: 0.9002 V

Number of CPU Cores: 64
Number of Logical CPUs: 128

Operating Points
CPU Minimum: 400.0 MHz = 4.00 x 100.0 MHz
CPU Base: 2450.0 MHz = 24.50 x 100.0 MHz
CPU Boost Max (Fmax): 3700.0 MHz = 37.00 x 100.0 MHz
Precision Boost Clock Limit: 3700.0 MHz = 37.00 x 100.0 MHz
CPU Automatic Overclocking Offset: 0 MHz

 

[izx]

How are you cooling it? Also, can you run cinebench multi-core test and see what you max boost freq is in HWinfo for all cores enabled.

I'm not very familiar with Cinebench, but here are some quick and dirty Cinebench23 multi-core results with SMT enabled (cooling with a SM 2U SP5 active heatsink)

• All-core boost seems to be limited to 2.55 GHz (HWInfo)
• CPU hits EDC limit of 255A while PPT/TDP is ~220W
• The EDC limit can be bypassed, but I want to be careful experimenting. PPT should be hard-capped at 240W though.
• Trying to decrease the SOC (uncore) power usage (e.g. reducing RAM speed) may give more boost headroom to the cores.

 

[nutsnax]

I just got two of these running on an Asrock ROME2D16 motherboard.

This combination does *****NOT***** like DDR4 2400 LRDIMMs at all.

 

[izx]

I just got two of these running on an Asrock ROME2D16 motherboard.
This combination does *****NOT***** like DDR4 2400 LRDIMMs at all.

Can you elaborate?
I have one on a ROMED8 and was considering getting some DDR4-2666 64GB LRDIMMs for it.

 

[nutsnax]

Can you elaborate?
I have one on a ROMED8 and was considering getting some DDR4-2666 64GB LRDIMMs for it.

Well, it just doesn't work. I can make it post with maybe one or two LRDIMM's but the moment I try more it won't post. error code 16 I think? It's hard to see the post code.

I switched to 2933 64GB RDIMMS and it works fine. Really weird.

 

[wildpig1234]

maybe it's because it's OEM cpu

 

[nutsnax]

maybe it's because it's OEM cpu

Have you seen any other instances like this? Where OEM CPU's aren't compatible with LRDIMM's?

 

[Advin]

@nutsnax @wildpig1234 @izx

It’s a widespread issue with ROME and Milan

https://forums.servethehome.com/index.php?threads/mz32-ar0-no-ipmi-or-no-post-solved.40440/#post-402928

I think someone in the MZ32-AR0 firmware thread got it working by modifying timings. But either way, not recommended.

It will sometimes boot in small quantities but not in large. I didn’t mention it in the thread but I had same problem with EPYC 7502

 

[nutsnax]

@nutsnax @wildpig1234 @izx

It’s a widespread issue with ROME and Milan

https://forums.servethehome.com/index.php?threads/mz32-ar0-no-ipmi-or-no-post-solved.40440/#post-402928

I think someone in the MZ32-AR0 firmware thread got it working by modifying timings. But either way, not recommended.

It will sometimes boot in small quantities but not in large. I didn’t mention it in the thread but I had same problem with EPYC 7502

Wow that is so crazy, I've got a 7D12 on a H11SSW-NT that will take 64GB BM1-CRC5Q LRDIMM's loaded in both slots on all but one memory channel. I'd wondered if this was a sign of bad or failing memory channels but I dunno?

Also my MZ32-AR0 with an Epyc 7532 both from Tugm takes these same LRDIMM's like a champ.... no issues

 

[Advin]

Wow that is so crazy, I've got a 7D12 on a H11SSW-NT that will take 64GB BM1-CRC5Q LRDIMM's loaded in both slots on all but one memory channel. I'd wondered if this was a sign of bad or failing memory channels but I dunno?

Also my MZ32-AR0 with an Epyc 7532 both from Tugm takes these same LRDIMM's like a champ.... no issues

I have some LRDIMM kits that work and some that don't, I think whether they work or not could be due to age or where the LRDIMM came from
I have 2 LRDIMM nodes in production, 1 with MZ32-AR0 and 1 with Tyan board but I am scared of rebooting them or touching them

 

[nutsnax]

I have some LRDIMM kits that work and some that don't, I think whether they work or not could be due to age or where the LRDIMM came from
I have 2 LRDIMM nodes in production, 1 with MZ32-AR0 and 1 with Tyan board but I am scared of rebooting them or touching them

It seems like Epyc is picky about RAM. Going forward I'm going to look to RDIMM's

It's unfortunate, but hopefully the motherboard manufacturers can do something on their end.

 

[GhettoSuperstar]

Everyone is going to get a kick out of this. I have MZ32-AR0 Rev.1 with Epyc 7713. I am able to run 4 sticks of Samsung 64gb RDIMM (with a speed rating of 3200) and 4 sticks of Samsung 64gb LRDIMM (rated at 2400) together. Everything runs at the lowest speed of 2400 without any issues. I saw it in manual that 8 channels all act like separate controllers and can be mixed RDIMM/LRDIMM. Blown away by this. I currently don't do run this. I have 6x64gb Samsung RDIMM running at 3200 speed. Still trying to find the last two sticks at less than $100.

 

[nutsnax]

Everyone is going to get a kick out of this. I have MZ32-AR0 Rev.1 with Epyc 7713. I am able to run 4 sticks of Samsung 64gb RDIMM (with a speed rating of 3200) and 4 sticks of Samsung 64gb LRDIMM (rated at 2400) together. Everything runs at the lowest speed of 2400 without any issues. I saw it in manual that 8 channels all act like separate controllers and can be mixed RDIMM/LRDIMM. Blown away by this. I currently don't do run this. I have 6x64gb Samsung RDIMM running at 3200 speed. Still trying to find the last two sticks at less than $100.

that is insane......

I was going to unload my MZ32-AR0 but now I'm tempted to keep it and sell my 7532 because it actually works with these LRDIMM's

 

[GhettoSuperstar]

that is insane......

I was going to unload my MZ32-AR0 but now I'm tempted to keep it and sell my 7532 because it actually works with these LRDIMM's

Why were you going to sell it?
For me, my only issue i have is that I can't run 3.7 all cores (Due to power limits, max tdp for the 7713 is 240w, my current cooling is extreme overkill). It will run 3.7 all cores if I turn off half the processor. And one last kicker, just picked up 2 intel P4500 4TB U.2 Drives for $360. Definitely keeping this.

 

[nutsnax]

Why were you going to sell it?
For me, my only issue i have is that I can't run 3.7 all cores (Due to power limits, max tdp for the 7713 is 240w, my current cooling is extreme overkill). It will run 3.7 all cores if I turn off half the processor. And one last kicker, just picked up 2 intel P4500 4TB U.2 Drives for $360. Definitely keeping this.

Because I got an Asrock ROME2D16 with two of these ES CPU's running on it. The only problem is that they won't run my BM1-CRC5Q LRDIMM's but my MZ32-AR0 takes them just fine.

 

[andygh]

I can confirm this batch of 7V13s work fine on an AsrockRack ROMED8-2T running the latest 3.80 BIOS.

TDP is 240W, and base (2.65-2.7) and boost (3.7) clocks match 7713.

What is the all core boost?

I see several sellers in ebay saying it to be 280w but they dont title them as ES? are these like proper ES? or just OEM?

 

[andygh]

View attachment 35917View attachment 35918

CPU temps reported in OCCT appear to be wrong; it looks normal in IPMI and other programs.

Using the latest BIOS M18_R34 flashed on REV 1.0 Gigabyte MZ32-AR0 board.

2.45 GHz base clock, meaning that this is most likely an EPYC 7763 OEM version, but OCCT is reporting 240W TDP by default (it could probably be increased to 280W in BIOS, but I'll leave it at 240W).

All 16 DIMMs are showing up, so memory channels are intact.

Can check momentarily if the all core boost hit 3.2 like 7763 if tdp is set 280w, [just one stress test], don't to hurt you vrms for long term

 

[Advin]

What is the all core boost?

I see several sellers in ebay saying it to be 280w but they dont title them as ES? are these like proper ES? or just OEM?

These are proper ES, it shows as engineering sample in BIOS and task manager.
The eBay listings without ES in the title are most likely the OEM variants that show as properly 7V13 in the BIOS and task manager (no engineering sample). The non-ES versions report as 7V13 in the OS and are ready for Oracle or whatever hyperscaler it was intended for.

Will run stress test in a bit, currently having some unrelated IPMI troubles

 

[izx]

What is the all core boost?

I see several sellers in ebay saying it to be 280w but they dont title them as ES? are these like proper ES? or just OEM?

Proper ES, as @Advin said.

And TDP is hard-capped at 240W.

I have not seen these go beyond 2.6-2.7 GHz in my limited all-core testing.

 

[andygh]

These are proper ES, it shows as engineering sample in BIOS and task manager.
The eBay listings without ES in the title are most likely the OEM variants that show as properly 7V13 in the BIOS and task manager (no engineering sample). The non-ES versions report as 7V13 in the OS and are ready for Oracle or whatever hyperscaler it was intended for.

Will run stress test in a bit, currently having some unrelated IPMI troubles

Thanks, please let me know. Also what is the single/dual core boosts are you getting?

Proper ES, as @Advin said.

And TDP is hard-capped at 240W.

I have not seen these go beyond 2.6-2.7 GHz in my limited all-core testing.

I see, what are the single/dual core boosts are you getting?