ES Xeon Discussion

[RolloZ170]

I have card for HDMI capture and to try make video with problem. May be video with describing problem is be some understanding.

My PC go in S3 waiting (all coolers is stoped) and return from it.

just disable that in your OS.

In paper manual with motherboard info "* S3 (Sleep) mode is supported only when 1 / 2 / 4 DIMMs memory modules are installed." is absent. In pdf manual it is present. Very interesting. This may be due to the 4 Amps current limit on the 5VSB line, which is specified in the description of the "Suspend to RAM" option in BIOS. Mass of PC PSU have 2,5-3 Amps for 5VSB

same is with some EPYC Bergamo motherboards, RDIMMs are supplied with +12V

 

[LuisGarcia]

Hi everybody.

I got a QYFS 56c.
It works on my Asus WS790 ACE but only under Windows 10 (not in w11) and with a maximum of 48 cores enabled.
If I set the number of cores to 56 the OS wont boot. The 56 cores can be seen on Bios as well as on Hwinfo, but i can only put 48;of them in use.
Is 48 cores a limitation of Windows 10?

By the way, Windows 11 incompatbility can be circumvented in any way?

Regards.
Luis.

 

[RolloZ170]

It works on my Asus WS790 ACE but only under Windows 10 (not in w11) and with a maximum of 48 cores enabled.

have you set package C-States to C0/C1 (or C2) ?

If I set the number of cores to 56 the OS wont boot.

no errors ?

By the way, Windows 11 incompatbility can be circumvented in any way?

no W10/W11 works fine with a healthy QYFS.
i guess yours has defective cores.

https://forums.servethehome.com/index.php?threads/asus-pro-ws-w790e-sage-se-intel-xeon-sapphire-rapids-spr-sp.41306/

 

[LuisGarcia]

It was solved by setting c-state to C2. Formerly it was set to Auto.
This setting solves both problems, Windows 10 is able to use the whole 56 cores and W11 boots without any problem!
Thanks for your help!

 

[foR]

Hi all,

Long time lurker here, is the ASRock Rack > Server Motherboard > SP2C741D16-2T viable with 1 or two 9480 max or QYFS or Q2SR or any other high end suggestions?

Regards

 

[RolloZ170]

Long time lurker here, is the ASRock Rack > Server Motherboard > SP2C741D16-2T viable with 1 or two 9480 max or QYFS or Q2SR or any other high end suggestions?

SP2C741D16-2T does not Support SPR-HBM
tested on SPC741D8UD : it will start over but without using any HBM (unpowered/disabled)
QYFS is not supported by official BIOS, there is a tweak (add microcode and some more)
Q2SR (EMR A0) runs with the same tweak required on gigabyte boards(can be applied by BMC/IPMI)

 

[foR]

SP2C741D16-2T does not Support SPR-HBM
tested on SPC741D8UD : it will start over but without using any HBM (unpowered/disabled)
QYFS is not supported by official BIOS, there is a tweak (add microcode and some more)
Q2SR (EMR A0) runs with the same tweak required on gigabyte boards(can be applied by BMC/IPMI)

Thankyou Rollo! Give's me something to consider now. What hardware are you running and tasks do you put it to?

 

[LuisGarcia]

Hi.
Another question i have, when using QyFS on Asus W790 ACE. I have noticed that some features, like SGX, TDX, an a few others, appear as not supported when checking cpuid and some MSR registers. Is this happenning because W790 Bios is not supporting them, or there is another reason for that ? (I am assuming QYFS has these features supported on silicon; perhaps am I wrong?).

 

[RolloZ170]

Another question i have, when using QyFS on Asus W790 ACE. I have noticed that some features, like SGX, TDX, an a few others, appear as not supported when checking cpuid and some MSR registers

note if you are running W11 your app runs by default in a VM ( Virtualization-based security, or VBS )
and can't access these info's. check with W10 or disable VMX on W11 in BIOS to see.

 

[LuisGarcia]

You are right again! I have disabled VBS and the SGX now shows as "supported". TDX still displayed as ";not supported", I guess it needs some initialization at the Bios level that is not performed on my Asus motherboard.

 

[RolloZ170]

TDX still displayed as ";not supported", I guess it needs some initialization at the Bios level that is not performed on my Asus motherboard.

if you need 4th gen scalable with TDX you have to buy custom OEM SKUs.

Select cloud service providers provided custom SKUs of 4th Gen Intel® Xeon Scalable processors enabled with Intel® TDX to support early availability programs, but those SKUs are not generally available in the market.

 

[justinjja1]

Bought a pair of QYFS without doing any research, oops lol.

What board would be my best option? MS73-HB1 (1.x or 3.x?) or SP2C741D16-2T
and x13's are a no go?

 

[RolloZ170]

Bought a pair of QYFS without doing any research, oops lol.

What board would be my best option? MS73-HB1 (1.x or 3.x?) or SP2C741D16-2T

MS73 ok
1.x comes with 4th gen BIOS Fxx from factory.
3.x comes with 4th/5th gen BIOS Rxx from factory.
SP2C741 don't support D0

and x13's are a no go?

supermicro don't support D0
( BIOS RoT protected = no mods.)

 

[justinjja1]

MS73 ok
1.x comes with 4th gen BIOS Fxx from factory.
3.x comes with 4th/5th gen BIOS Rxx from factory.
SP2C741 don't support D0

supermicro don't support D0
( BIOS RoT protected = no mods.)

Awesome thank you,
Is there a specific or custom bios I need for the MS73-HB1?

 

[RolloZ170]

Is there a specific or custom bios I need for the MS73-HB1?

only for EMR A0 (Q2SR,Q2SP,Q30H,Q30G,Q2T7...)
D0 is official supported by all Gigabyte C741 BIOS.

 

[iKpuc]

Hi!
If someone takes 2x Q2SR + ms73 for Deepseek R1, then here are the optimal bios settings:
Disable half of the cores on each socket (ffff0000ffff0000)
SNC=disabled
Numa=enabled
Virtual numa=disabled

The remaining settings for maximum performance, turn off the energy saver + turn on the frequency lock.

Launched via ik_llama.cpp:
numactl --interleave=all ./ik_llama.cpp/build/bin/llama-cli -m ~/DeepSeek-R1-Q4_K_M/DeepSeek-R1-Q4_K_M-00001-of-00009.gguf -ctk f16 -ctv f16 --numa numactl --numa distribute --threads 64 --ctx-size 8192 --seed 3407 -if

7,6-7,9 t/s

Adding:
DeepSeek-R1-Q4_K_M - build ik_llama.cpp under ubuntu

Generation:
~10 t/s - up to 100 tokens
~8 t/s - up to 2000 tokens
~7 t/s - up to 5,000 tokens
~6 t/s - up to 10,000 tokens

Bench:
pp1000 - 105.46t/s
pp512 - 109.69t/s
tg128 - 8.74t/s

 

[zm12]

hi! I'm new here, and I noticed a special sku named q08u, the base frequence = 3.4G (lazered marked on the top), and the max boost frequence is 4.2G. The performance of q08u is like a beast. But I also found there are also q08v, while it has a base feq= 1.7G. Is q08u the only one that has such a high frequence?

 

[RolloZ170]

Is q08u the only one that has such a high frequence?

yes not with high core count, seems to be a predecessor of a OEM SKU like 8481C
Q08U is E0 step 4

 

[alderlake12th]

I've had hands-on experience with these boards from just dealing with the Precision 5860s elsewhere. These suck; very long post times ~1m 20s with nothing of note enabled.
Quirk: Powering off by holding the power button, like most Dell Precisions, causes them to power back on -then- off, which can be confusing if this behavior isn't known. But on the 5860 it takes the better part of a minute before it powers back off to let you try to power on and boot normally.
Proprietary front panel, PSU connections too. Non-bypassable fan and even M.2 heatsink warnings (causing another 1m 20s POST sequence if acknowledged), proprietary fan connection, etc.

From the bottom of my heart, use a different board.

I also looking for this 5860 motherboard
My budget is pretty narrow (1000$) so F4Y1M is the best choice here. I want it with QYFS
Do we have something noticeable or maybe locked like some epyc/threadripper. POST time could be reduced by something? Also, we need 5860 case or something could be it's case? How about non-bypassable fan and m.2 heatsink? Could you explain further?

 

[RolloZ170]

I also looking for this 5860 motherboard
My budget is pretty narrow (1000$) so F4Y1M is the best choice here. I want it with QYFS

https://forums.servethehome.com/index.php?threads/es-xeon-discussion.5031/post-465428

i have one at home. QYFS do not work without modifications (i am on it but no guarantee that it will ever work)
( even 34xx series processors do NOT work by intention, dell sells the Precision 7960 for those. )
you need at least a 750W Dell Power upply, around $189. FAN Adapters are there on ebay/Amazon.
as you see the motherboard is propriätäry and fit only in the original 5860/ ??7865?? case ($150 / china)

POST time could be reduced by something?

solve all warnings, its easy(e.g. just install the M.2 Heatsink)