H11DSi with Dual Epyc failing to boot Windows Server install (2016 and 2019)

[Layla]

Anyone have issues installing Windows Server (2019 or 2016) on H11DSi?

It appears to get stuck at [INFO] Launching 'efi\boot\bootx64.efi'...

On the HDMI port out of the GPU, it just shows the SuperMicro UEFI BIOS Logo, while the IPMI HTML5 iKVM displays the UEFI command history.

If I leave it sitting for a while, it doesn't appear to make any progress...

 

[Layla]

https://support.microsoft.com/en-us/help/4514607/windows-server-support-and-installation-instructions-for-amd-rome-proc

Seems relevant, implies that SMT should be disabled on the 64C Epyc CPUs -- I assume this means just for installation...

 

[Layla]

https://support.microsoft.com/en-us/help/4514607/windows-server-support-and-installation-instructions-for-amd-rome-proc

Seems relevant, implies that SMT should be disabled on the 64C Epyc CPUs -- I assume this means just for installation...

Turning off SMT gives the spinning windows startup logo over the SuperMicro BIOS screen, and then starts the Windows Server 2019 installation.

 

[bayleyw]

Yeah, I think Windows needs a patch to work with more than 0xFF threads.

 

[Layla]

Interestingly, after installing Windows Server 2019, doing all the updates, installing the SP3 driver pack, NVIDIA drivers, etc., I just tried to re-enable SMT, and it now hangs during POST with POST code 0x55 (Memory not installed, according to https://www.supermicro.com/manuals/other/AMI_BIOS_POST_Codes_for_Grantley_Motherboards.pdf)

This system is pretty frustrating to get setup properly.

 

[traderjay]

Is your cpu retail same or ES?

 

[Patrick]

Did you try this? https://support.microsoft.com/en-us...d-installation-instructions-for-amd-rome-proc

We had to get a patch last August to do the initial benchmarks because Windows couldn't handle that many threads per CPU. From what I understand it was brought into standard WS2019 distributions last fall.

 

[i386]

From what I understand it was brought into standard WS2019 distributions last fall.

People in the proper channels (volume license users, visual studio subscriptions etc.) should have acces to the updated iso files.
Not sure how many times the public available evaluation iso is updated (or if it gets any updates at all).

 

[Arphy]

I installed OpenSUSE on H11DSI-NT and cannot get it to boot with UEFI, so I fell back to legacy boot and it booted successfully.

I guess it is a problem with the bios. But since the legacy works fine for me so I never gotten around to update the bios yet.

 

[Layla]

I thought I'd updated this post with the fix, but apparently not... :/

https://forums.servethehome.com/index.php?threads/finally-overclocking-epyc-rome-es.28111/post-272812

 

[ari2asem]

@Layla i am in the same boat as you. i have dual epyc 7742 (oem version) on h11dsi-nt rev.2.board.(bios version 2.0b. no bios mod)

during installation windows 10 v2004 enterprise or windows server 2019 datacenter gui, i had to disable SMT and IOMMU. then installation went normal.

after installation when i enable smt and iommu, my system hangs at blue square windows boot-logo.

disabling smt and enabling iommu, i get boot device error ( blue bsod screen). i use m2.nvme as boot storage. so, to get into windows i need to disable smt and iommu.

what kind of storage do you use to get into windows server while enabling smt ??

 

[ari2asem]

UPDATE: this is so stupid. installed windows 10 v2009 (20H2) enterprise on 2.5inch ssd (connected via sata-dom port and normal sata-power cable).

before installation:
disable smt and iommu, enable above 4g.

after installation and all windows updates:
enable smt, above 4g and iommu. iommu is on ENABLED, not on AUTO.

my bios: SM original 2.0b, no mods
boot option: LEGACY,
LEGACY to UEFI is disabled.

all other settings are default

now i have all 256 logical threads. will run monero-mining for test.


my next step: pick an other m2.nvme and test this whole thing with that one

 

[ari2asem]

UPDATE 2: running xmrig v6.3 (monero miner, cpu miner) gives me very hot cpuvrm, around 90°C with 2 small fans (40mm*10mm) on metal cool block between 2 cpu-sockets.

without small fans, after 2 minutes of mining system gives alarm, because cpuvrm gets 100°C.

my voltages during mining is around 0,90-0,96 Volt.

what is your experience when you full load (100% and all 256 threads) the cpu's, @Layla ??

 

[norcimo]

UPDATE 2: running xmrig v6.3 (monero miner, cpu miner) gives me very hot cpuvrm, around 90°C with 2 small fans (40mm*10mm) on metal cool block between 2 cpu-sockets.

without small fans, after 2 minutes of mining system gives alarm, because cpuvrm gets 100°C.

my voltages during mining is around 0,90-0,96 Volt.

what is your experience when you full load (100% and all 256 threads) the cpu's, @Layla ??

i'm not there yet, however I am use CRYORIG water coolers on both CPUS. I'm running memory testing , it seems the system randomly hard resets by itself. SO far the testing is good, at 58%, I also re positioned the memory around, in hopes that it was the cause. Once I start mining I'll let you know how it does with the temps. Do you know of a good temp monitoring software?

 

[Layla]

UPDATE 2: running xmrig v6.3 (monero miner, cpu miner) gives me very hot cpuvrm, around 90°C with 2 small fans (40mm*10mm) on metal cool block between 2 cpu-sockets.

without small fans, after 2 minutes of mining system gives alarm, because cpuvrm gets 100°C.

my voltages during mining is around 0,90-0,96 Volt.

what is your experience when you full load (100% and all 256 threads) the cpu's, @Layla ??

Sorry for the delayed reply; I didn't see a notification. I think I'm using 3x40mm fans on VRMs. I get about 65-85*C on the VRMs depending upon load. CPUs (Noctua NH-U14S) seem to be about 40-70*C, if I recall correctly. I haven't had any alarms yet; but, I did have the system go black and be unable to be reset once, and I worried briefly that I'd killed the CPUs. Luckily not, and that hasn't happened since.