Drag to reposition cover

ASUS Pro WS W790E-SAGE SE + Intel Xeon Sapphire Rapids SP ES = works it

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Jeff Robertson

Active Member
Oct 18, 2016
429
115
43
Chico, CA
Awesome project! I've been considering something similar so here are some questions:

What is the idle power draw like?
Can you use m.2 drives in a RAID array? And will it take 110mm length drives?

My use case would be as a server running about three dozen VMs on Server 2022 and I would like to be able to boot off of a RAID1 M.2 array.
 

Kizune

Member
Dec 2, 2022
43
33
18
check the manual. 110 is supported. but both CPU M.2 are only available with 112L CPU.
Also by default VROC (Virtual Raid On CPU) works only with Intel branded SSDs, in order to create RAID with non-Intel ones you will need the VROC Key - the standard key (VROCSTANMOD key) is enough for RAID 0/1/10. That key works with both m.2 and PCIe add on SSD cards (also with SSDs connected to MiniSAS connectors).
 
  • Like
Reactions: RolloZ170

JosefHrib

Member
Jul 25, 2023
52
40
18
38
What is the idle power draw like?
For example in my case, if it concerns only the processor, not the rest of the system, so my QYFS (56C/112T 350W) when is set in Windows High Performance Mode consumes in Idle approx +- 170W, when is set in Windows Balanced Mode consumes in Idle approx +- 90W (corrected from +-70W). But that's just the processor. As Rollo wrote, it also depends on the rest of the system, there is no simple answer to this.

Otherwise off topic, if someone need more SSD and want PCIe5 with D0 and W790, so can use one day back released ASUS Hyper M.2 x16 Gen5 Card. The official MSRP is only $79, it looks pretty cool. :) If will be available in my country, so I want one piece buy for testing with my W790 SAGE.
ASUS-Hyper-M.2-x16-Gen5-Card.jpg
 
Last edited:

Jeff Robertson

Active Member
Oct 18, 2016
429
115
43
Chico, CA
For example in my case, if it concerns only the processor, not the rest of the system, so my QYFS (56C/112T 350W) when is set in Windows High Performance Mode consumes in Idle approx +- 170W, when is set in Windows Balanced Mode consumes in Idle approx +- 70W. But that's just the processor. As Rollo wrote, it also depends on the rest of the system, there is no simple answer to this.

Otherwise off topic, if someone need more SSD and want PCIe5 with D0 and W790, so can use one day back released ASUS Hyper M.2 x16 Gen5 Card. The official MSRP is only $79, it looks pretty cool. :) If will be available in my country, so I want one piece buy for testing with my W790 SAGE.
View attachment 32178
That is exactly what I'm looking for so thank you for posting. My build would be pretty simple, 28 core version, 256GB RAM, 2x NVMe SSDs and not much else. I currently have an Epyc 7402 24 core setup that uses about 150W at idle so the Xeon W might be a bit of an upgrade while using less power.
 
  • Like
Reactions: JosefHrib

JosefHrib

Member
Jul 25, 2023
52
40
18
38
That is exactly what I'm looking for so thank you for posting. My build would be pretty simple, 28 core version, 256GB RAM, 2x NVMe SSDs and not much else. I currently have an Epyc 7402 24 core setup that uses about 150W at idle so the Xeon W might be a bit of an upgrade while using less power.
Gen5 Card will be out very soon.
 

scouzi

Member
Jan 8, 2024
39
7
8
I want to share my experience with SPR-SP ES2 D0 and motherboard ASUS Pro WS W790E-SAGE SE with chipset W790 for SPR-WS.

Specs:
CPU: Intel Xeon Sapphire Rapids QYFQ ES2 D0 48C/96T 97,5MB L3 270W similar to Xeon Platinum 8468V
CPU: Intel Xeon Sapphire Rapids QYFS ES2 D0 56C/112T 105MB L3 350W similar to Xeon Platinum 8480+
MB: ASUS Pro WS W790E-SAGE SE LGA4677 8Channel (BIOS 0215, ME 16.10.5.1583)
RAM: 128GB (8x16GB) Kingston FURY Renegade Pro 6000MHz CL32 DDR5 RDIMM ECC REG (Default JEDEC 4800MHz, XMP1 6000MHz)
GPU: NVIDIA GeForce RTX 3080 Ti Founders Edition -> ASUS ROG Strix GeForce RTX 4090 OC Edition 24GB GDDR6X
SSD: 2TB Samsung 990 Pro NVMe SSD -> ASUS Hyper M.2 x16 Gen5 | 4TB Samsung 990 Pro NVMe SSD
PSU: Seasonic PRIME TX 1600W ATX3.0 SSR-1600TR2
CPU Cooler: Silverstone SST-XE360-4677
Case Fans: 4x Phanteks T30 PH-F120T30
Fans Hub: Noctua NA-FH1 8 Channel Fan Hub
Case: Fractal Design Define 7 XL with Vented Front Door from Coldzero
Audio Device: SupremeFX Realtek S1220A
WiFi Device: Intel BE200NGW WiFi 7
Monitor: ASUS ROG Strix XG32UQ

After a installed Windows 11 Pro, I installed the following drivers:
ASUS website:
DRV_Chipset_Intel_21H2_TP_W10_64_V101196008418_20231020R link
DRV_MEI_Intel_Corp_RPL_TP_W11_64_V2334510_20230920R link
DRV_VGA_ASPEED_TP_W11_64_V9010115_20230817R link
Intel_Ethernet_X710_Driver_V1.16.202.1_for_Windows_10_64-bit link
Intel_Chipset_Driver_V10.1.19263.8344_for_WIN10_WIN11_64-bit link
Intel_Serial_IO_V30.100.2221.20_for_WIN10_WIN11_64-bit link
Realtek_Audio_Driver_V6.0.9400.1_for_WIN10_WIN11_64-bit link
Intel website:
QAT2.0.W.2.0.5-0014.zip link
Samsung website (because I using Samsung SSD):
Magician Software link
NVIDIA website (because I using NVIDIA GPU):
GeForce Driver link

In BIOS: Asus Multicore Enhancement Enabled Remove all Limits for CPU, Water Cooling Profile for CPU, XMP1 for RAM
In Windows: High Performance Mode
In Device Manager is all fine, no problem. Everything works out of the box, instantly, without any issues

1.Tested CPU: QYFQ
Intel Xeon Sapphire Rapids QYFQ ES2 D0 48C/96T 97.5MB L3 270W similar to Xeon Platinum 8468V
Default base 1.5GHz boost all cores 2.5GHz 270W TDP
With Windows High Performance Mode stable frequency +- 2.0GHz/2.1GHz, under load +- 2.5GHz/2.7GHz, idle +- 1.7GHz/2.0GHz (With Windows Balanced Mode Idle 800MHz)
Screenshot 3-7

2.Tested CPU: QYFS
Intel Xeon Sapphire Rapids QYFS ES2 D0 56C/112T 105MB L3 350W similar to Xeon Platinum 8480+
Default base 1.9GHz boost all cores 2.8GHz 350W TDP
With Windows High Performance Mode stable frequency +- 2.5GHz-2.6GHz, under load allcore +- 2.7GHz/2,8GHz singlecore +- 3,4GHz/3,5GHz, idle +- 1.9GHz/2.0GHz, idle TDP +- 170W (With Windows Balanced Mode Idle 800MHz TDP +-90W)
Screenshot 8-17

If anyone has question to W790 with server variant Sapphire Rapids SPR-SP, you can write me bellow, if I can answer or give advice, I will certainly be happy to answer.

Ps: I would like to thanks the user @RolloZ170 for helping me get my first piece ES2 D0 QYFQ aka 8468V.
Sorry to resurface an old thread.. But did you install your QYFS CPU with the E1A carrier clip? Or without one?
 
  • Haha
Reactions: JosefHrib

DHamov

Member
Jan 12, 2024
98
20
8
as Kizune already mentioned latest BIOS will not work with most D0 stepping SPR-SP ES2.
i have tested some with ASUS WS W790-Ace:

QYFQ only BIOS 0403, but 0506/0705 hangs up on Windows device initialization phase
QYFP all BIOS 0403/0506/0705 works
QY06 only BIOS 0403, but 0506/0705 hangs up on Windows device initialization phase
QY0C only BIOS 0403, but 0506/0705 hangs up on Windows device initialization phase
update:
windows hang solved by BIOS tweak
Sorry for replying to al older post. All parts arrived i started building. Dumb me trying to fit that silly carrier bracket, on top of the cpu QYFS without first looking in some manuals. But luckly nothing got broken, except my confidence so i humbled myself and looked some video, and voila. But....
My question about the post above is if the windows hang was solved by the bios tweak for all bios versions (and is there some other setting to fix) or is it only up to 0403?

On my Asus w790-ace was already the 0705 bios, i did the bios tweak (C-States from Auto to enabled, Package C-State from Auto to C2) Then could load ubuntu life, did not try the install (maybe i will later).
But windows 10 pro install hanged at startup. Now i rolled back the bios to 0403. And it was possible to install windows.
So is it only working for bios 0403? or should it also work up to 0705 and did i miss some other setting, that i could not find or did not think of?

During some of the restarts in the process, sometimes the computer would not post and i got some F0 code.
When i tried to flash the bios, i also got a restart one time. Not so confident about the set up yet, but still early.
 

RolloZ170

Well-Known Member
Apr 24, 2016
5,427
1,644
113
My question about the post above is if the windows hang was solved by the bios tweak for all bios versions (and is there some other setting to fix) or is it only up to 0403?

On my Asus w790-ace was already the 0705 bios, i did the bios tweak (C-States from Auto to enabled, Package C-State from Auto to C2) Then could load ubuntu life, did not try the install (maybe i will later).
But windows 10 pro install hanged at startup. Now i rolled back the bios to 0403. And it was possible to install windows.
So is it only working for bios 0403? or should it also work up to 0705 and did i miss some other setting, that i could not find or did not think of?
only above first BIOS but i never had a QYFS. maybe you have to try the hard way.
CPU Power Management Configuration_[22-18-53]ccc.jpg
 

Kizune

Member
Dec 2, 2022
43
33
18
only above first BIOS but i never had a QYFS. maybe you have to try the hard way.
My settings. QYFS, BIOS 08.05 (latest at this moment), Windows 11 Pro - no problem at all. I had problems with 07.05 - memory overclock did not work. With 08/05 i see no problem here. Although the m.2 RAID ussie still not fixed - as long as system starts up and the VROC assembles the RAID0 from my two m.2 SSDs the HDD activity LED goes on and stays on forewer. If i turn VROC off LED accurately shows activity on them. Weird. But whatever.
bios1.jpg
 

DHamov

Member
Jan 12, 2024
98
20
8
Thanks for the screenshots both of you!
Before i saw these i tried a zillioin combinations yesterday, and only got in windows 10 with C-states disabled on bios 0705. Memory overclock was also not working for me, in bios 0705 all the time some F0 error, black screen at start up, it just worked at the stock 4800 but no 5200 or 5600 on my fury pro 5600. Mem overclock was also not working at bios 0403, i also saw the newer bios, 0805 but i was affraid to try...thinking: what if i cant post, i would not know how to ever get the old bios back again? Is it possible or were you just so courageous to try? Or do you have another cpu to reset things? or does bios flash always work?

I am no overclocker, but when things are new i like to know max performance, and then later run it safer with some margin. With 4800 mem speed 2 x 32gb sticks or 4 sticks i cant get over 59k CB 23. And then i am already using some thermal settings, that i rather not use on the long term. On the other hand Power draw during benchmarks never gets above 380W even if i raise the limits. Intel software optimization raises the limits to 500W or so. With Balanced power settings i get around 54K CB R23. But i saw people getting scores much higher 67k, even reported 63k single socket 2 sticks on GIGABYTE MS73, thus also with stock memory speeds (4800Mhz). With 2 sticks Fury pro at 4800 my mem speed read is 67GB/s in Aida64, wich is about 1/4 of what JosefHrib had with 8 sticks of FURY Renegade Pro 6000MHz. I will try the new 0805 bios later today.
 

RolloZ170

Well-Known Member
Apr 24, 2016
5,427
1,644
113
I am no overclocker, but when things are new i like to know max performance, and then later run it safer with some margin.
keep in mind you have ES and there is always a silicon lottery. even prod.unit X/K models are binned by some sellers.
With Balanced power settings i get around 54K CB R23. But i saw people getting scores much higher 67k
Don't believe any statistics that you haven't falsified yourself
with old GPU i rised BCLK to 109mhz and got higher results. but don't work with actual GPU (PCIe clock rises too)
 

JosefHrib

Member
Jul 25, 2023
52
40
18
38
keep in mind you have ES and there is always a silicon lottery. even prod.unit X/K models are binned by some sellers.
True, true. For example I myself previously owned one piece i9-13900K, and two pieces i9-13900KS. And the first piece of i9-13900KS was worse than the normal Non-S variant.

Don't believe any statistics that you haven't falsified yourself
with old GPU i rised BCLK to 109mhz and got higher results. but don't work with actual GPU (PCIe clock rises too)
If you want, so you can pickup my results CBR23 as standart (+-). Because I set only ram modules to xmp1 and under win11 cpu to performance mode. Zero BCLK OC. Because I used my QYFS with only these GPUs RTX3080Ti,RTX3090, and now RTX4090. And all these GPUs not love any BCLK OC. black screen.
 

DHamov

Member
Jan 12, 2024
98
20
8
If you want, so you can pickup my results CBR23 as standart (+-). Because I set only ram modules to xmp1 and under win11 cpu to performance mode.
Yes i was doing that, and negatively amazed about my relatively poor performance. I got only 59K CBR23 so far. But in general its still a very powerful cpu. but over 10% difference still seems quite a lot.
Yes i know about the silicon lottery and benchmark beautification:(. Still i would trust the benchmarks i saw here on the forum from users. I do not really want to go BLCK, if i have time i would play with undervolting, and thermal settings.

Bios 0805, is working, but memory overclocks still only work manually. XMP not working get some unknown f0 error with almost any setting apart from 4800MHz.

With 4x32GB Fury pro 5600 manual, timings i get 56K in CBR23 Aida6 Memory reas speed is now 114GB/s about 2x more as with 2 sticks. and now about half of the 235GB/s JosefHrib got. Which was interesting because, i thought that theoretically for 4 channels 4 RDIMMS of 1Rx4 should be better than 8 RDIMMS, because besides overclocking according to officiall specifications with 2Dimms per channel speed reduces to 4400, instead of 4800 (at least that is how i understood it).
But with 8 sticks and 4 channels JosefHrib still has double the bandwidth. So probably i misunderstood something. Maybe the difference is also 1Rx8 vs 1Rx4? I am very curious if someone with an 8 channel board, and 8 dimms could run AIDA64 and see the bandwidth? Would that then be double of the 235GB/s?

EDIT: JosefHrib i went trough your screenshots again, did you notice this?
JosphHrib_OCTAL_CHANNEL.JPG
It says Octa channel with yours! Maybe the mainboards only specify 4-channel because the cpu's they officially support are up to 4 Channels but with these they might be actually 8?
 

Attachments

Last edited: