AMD EPYC 7713 w/Gigabyte mz32-ar0 Boost Speed Question.

[GhettoSuperstar]

I picked up the following at the beginning of December:

• Processor: AMD Epyc 7713 64 core
• Motherboard: Gigabyte MZ32-ar0 ver.1 (I bought Epyc 7251 to test and flash the motherboard to work 7003 CPUs.)
• Memory 256gb Samsung DDR4 3200 ECC mem (4x64gb)

On the bench everything tested okay, was able to upgrade the UEFI bios to work with the Epyc 7713 chip. Used an AMD 6600xt for video.

So i proceeded to build out a liquid cooled workstation.
Picked up the following:

• Case: Thermaltake The Tower 900
• CPU Waterblock: EK Quantum Magnitude sTRX4 CPU Water Block
  • modified with EKWB Quantum Vector Xtreme Aorus RTX 3080/3090 Plexi With Nickel Backplate
  • Backplate modified with thermal tape attached black heatsinks with arctic 40mm fans
• Video Card: AORUS GeForce RTX 3090 MASTER 24GB
• Radiators: Dual Bitspower Leviathan XF 480mm Radiator PC Cooling (54mm thick)
• Pump: Thermaltake Pacific PR22-D5 Plus
• Power supply: EVGA SuperNOVA 1000 P2, 80+ PLATINUM 1000W (already had since 2021)

Took my time and built out the workstation over a month.




Going to answer a question right away. With this case why didn't I go with hard tubing? This is a workstation. Not going for looks. Going for power.

Here's my issue.
In my torture testing, with all 64 cores enabled and using the following to tune the bios:

• SPEC CPU2017 Platform Settings for ASUSTek Systems
• MI200 high-performance computing and tuning guide — ROCm Documentation

I am running into an issue where the max boost speed being reported by HWinfo is 3.1ghz when running all 64 cores.
I run tests where I disable cores in the bios and the boost speed changes to 3.7ghz with 32 cores and 3.5 with 48 cores.
I am using Windows 11 Pro for all testing. Not using Linux yet. Using all processors at same time, CPU temp hovers around 60C.
Single core testing, cores will boost to max boost speed being reported. Multi-Core 64 all core torture test boosts to 2.5ghz and 32 multi-core all core test boosts to 3.1ghz.
This is my first 64 core processor and the most I have done desktop/server is 16 cores.
For this or any Epyc processor is the rated boost actually false?

General Specifications for AMD Epyc 7713 Platform

• Server Product Family
• AMD EPYC™ Product Line
• AMD EPYC™ 7003 Series
• # of CPU Cores: 64
• # of Threads: 128
• Max. Boost Clock: Up to 3.675GHz
• Base Clock: 2.0GHz
• Default TDP: 225W
• AMD Configurable TDP (cTDP): 225-240W (I have mine set to max 280W)
• CPU Socket: SP3

 

[GhettoSuperstar]

Also, quick note, I am did put a 40mm Fan on the VRM that's for the CPU.

 

[nk215]

Impressive built.

I had a bad experience with water cooling years back and never really tried it again. I was on vacation and the pump failed so the server shut down.

I had my share of cooling fan failures and the CPU throttle but it never shut down. The high flow in server cases is enough to cool the CPU to a certain extent thanks to the massive heat sink of 4U coolers.

 

[RolloZ170]

I am running into an issue where the max boost speed being reported by HWinfo is 3.1ghz when running all 64 cores.

thats good for a 64core locked CPU. runs into max TDP thought.

 

[RolloZ170]

This is my first 64 core processor and the most I have done desktop/server is 16 cores.
For this or any Epyc processor is the rated boost actually false?

for the 7713 the all core turbo is 3,0Ghz
the max. turbo is for 1/2 cores.

 

[GhettoSuperstar]

thats good for a 64core locked CPU. runs into max TDP thought.

Setting TDP to 280W from auto allows the cpu/board to exceed TDP. 64 core full use hits 250w. Just realized later own had to cool the VRM to allow higher TDP.

 

[GhettoSuperstar]

for the 7713 the all core turbo is 3,0Ghz
the max. turbo is for 1/2 cores.

So this is very like the Desktop Ryzen processors.

 

[RolloZ170]

So this is very like the Desktop Ryzen processors.

yes, 7713 with 3,7 Ghz all core will need much much more than 220-240Watts, but this is the limit

 

[GhettoSuperstar]

Impressive built.

I had a bad experience with water cooling years back and never really tried it again. I was on vacation and the pump failed so the server shut down.

I had my share of cooling fan failures and the CPU throttle but it never shut down. The high flow in server cases is enough to cool the CPU to a certain extent thanks to the massive heat sink of 4U coolers.

I been watercooling for 18+ years now. My first radiators was modified Bonneville heater cores. I never had a pump die on me, but Zen microarchitecture has been pretty good with shutting down when a failure did happen. I had hard tubes melt on me due to high temps over a long period of time. Like six months.

 

[tas]

could you post benchmarks scores so we can compare to Ryzen/Threadripper ?

 

[GhettoSuperstar]

Sure can. Will do benchmarks tonight.