Supermicro X13SAE-F W680 Motherboard Mini-Review

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

driesmp

New Member
Apr 21, 2023
2
0
1
Yes need to update max tolud setting and some video settings per my link above.
Oh I see, weird that you need to change the tolud setting. The video setting makes sense, although I would think "auto" would also work. Enabling the iGPU is indeed a nobrainer if we want to use it, nice. With that config we can not use a display on the iGPU ports probably? (DP, HDMI)
 

Ivan Dimitrov

Member
Jul 10, 2016
52
5
8
40
Hi, can somebody of the happy owners answer a few question about the board:
  1. Is the memory speed really that abysmal as given in the specification (4400 MTS with SDPC and 4000 with DDPC)?
  2. Has somebody tried 96/192 GB of RAM on the board?
  3. Is bifurcation supported beyond the x8/x8? Can I go x8/(x4/x4)
  4. How are VRMS keeping up with the 13th gen processors? Are the CPUs power limited?
Thanks in advance.
 

WillTaillac

Member
Feb 28, 2020
71
41
18
Hi, can somebody of the happy owners answer a few question about the board:
  1. Is the memory speed really that abysmal as given in the specification (4400 MTS with SDPC and 4000 with DDPC)?
  2. Has somebody tried 96/192 GB of RAM on the board?
  3. Is bifurcation supported beyond the x8/x8? Can I go x8/(x4/x4)
  4. How are VRMS keeping up with the 13th gen processors? Are the CPUs power limited?
Thanks in advance.
1. It really does run the memory at 4400 MHz.
2. I haven't tried any of the 48 GB DIMMs, but it's perfectly happy with 4x 32GB. My guess would be no to the 32GB DIMMs, but I don't have any of them to test with.
3. I haven't looked myself, but the official Supermicro FAQ says No.
4. The beefiest CPU I have run on it is a 13700, which it is fine with. I haven't put any k-series CPUs on it, because that seems like a bit of a waste.
 

Ivan Dimitrov

Member
Jul 10, 2016
52
5
8
40
1. It really does run the memory at 4400 MHz.
2. I haven't tried any of the 48 GB DIMMs, but it's perfectly happy with 4x 32GB. My guess would be no to the 32GB DIMMs, but I don't have any of them to test with.
3. I haven't looked myself, but the official Supermicro FAQ says No.
4. The beefiest CPU I have run on it is a 13700, which it is fine with. I haven't put any k-series CPUs on it, because that seems like a bit of a waste.
Thanks for the reply. About the memory - are there manual setting to overwrite the memory speed? The CPUs now support much higher speeds and the memory is available. I was thinking that 5200/5600 MTS should be possible.
 

WillTaillac

Member
Feb 28, 2020
71
41
18
Thanks for the reply. About the memory - are there manual setting to overwrite the memory speed? The CPUs now support much higher speeds and the memory is available. I was thinking that 5200/5600 MTS should be possible.
I would have to go back into the BIOS on my system running the X13, which I may not be able to do for a while (it's a fairly important backup server for me). With that said, I do not believe it supports XMP so even if you wanted to do 5200/5600 you would have to do all the timings manually. I'll be honest, I bought 4400 RAM to pair with it because, well, it's a server and not a workstation.
 
  • Like
Reactions: Ivan Dimitrov

cdru

Member
Oct 27, 2018
44
32
18
About the memory - are there manual setting to overwrite the memory speed? The CPUs now support much higher speeds and the memory is available. I was thinking that 5200/5600 MTS should be possible.
Memory speed can be overridden, but only up 4400. Nothing beyond that. This is on the latest bios version (2.1) with a X13SAE-F board using a i7-12700K.

For your original questions:
1. I can confirm my 2x32 ECC DIMMS are running at 4400 even though they are rated (and identified as 4800). I don't have any extra to test if that drops down to 4000 with 4 installed.
2. Based on the niche board being a bit of a red-headed stepchild, I would expect a 50/50 chance of 3*32GB for 96GB would work. I would almost guarantee any combination of 48GB DIMMs would work.
3. You can't further bifurcate either of the physical 16x slots. You're stuck with either x16/x0 and x8/x8. The two x4 slots are ran off the W680 chipset. I've never used them and can't confirm if they'd work with this board, but there's been some NVME boards that utilize their own PCIe switch that don't rely on bifurcation support. They come at a price though.
4. I've had no power stability issues with a i7-12700K or i5-13600K installed that weren't induced by a feline standing on the power button. I wouldn't say I've particularly taxed either CPU though as a TrueNAS Scale server with a number of containers running in the background.

If you're looking to get the board, unless you need IPMI remote console or ECC support, I'd recommend looking at something else TBH. IMO it's not worth the premium cost.
 

rtech

Active Member
Jun 2, 2021
306
110
43
cdru could you show us IOMMU groups?

Bash:
#!/bin/bash
for d in /sys/kernel/iommu_groups/*/devices/*; do
  n=${d#*/iommu_groups/*}; n=${n%%/*}
  printf 'IOMMU Group %s ' "$n"
  lspci -nns "${d##*/}"
done
 

Ivan Dimitrov

Member
Jul 10, 2016
52
5
8
40
Memory speed can be overridden, but only up 4400. Nothing beyond that. This is on the latest bios version (2.1) with a X13SAE-F board using a i7-12700K.

For your original questions:
1. I can confirm my 2x32 ECC DIMMS are running at 4400 even though they are rated (and identified as 4800). I don't have any extra to test if that drops down to 4000 with 4 installed.
2. Based on the niche board being a bit of a red-headed stepchild, I would expect a 50/50 chance of 3*32GB for 96GB would work. I would almost guarantee any combination of 48GB DIMMs would work.
3. You can't further bifurcate either of the physical 16x slots. You're stuck with either x16/x0 and x8/x8. The two x4 slots are ran off the W680 chipset. I've never used them and can't confirm if they'd work with this board, but there's been some NVME boards that utilize their own PCIe switch that don't rely on bifurcation support. They come at a price though.
4. I've had no power stability issues with a i7-12700K or i5-13600K installed that weren't induced by a feline standing on the power button. I wouldn't say I've particularly taxed either CPU though as a TrueNAS Scale server with a number of containers running in the background.

If you're looking to get the board, unless you need IPMI remote console or ECC support, I'd recommend looking at something else TBH. IMO it's not worth the premium cost.
Thank you very much for the detailed answer. After looking for 2 days on s. 1700 and AM5 boards I reached the conclusion that Asus Pro WS W680-ACE IPMI might be the best from the current crop of Intel/AMD semi-server/workstation MB.
I like supermicro but this board seems too conservative to buy this late of the socket's life cycle. Also it seems AMD simply doesn't have alternative for these boards, unfortunately.
 

WillTaillac

Member
Feb 28, 2020
71
41
18
Also it seems AMD simply doesn't have alternative for these boards, unfortunately.
It depends really. As of this generation, I do not feel like either vendor is particularly well serving the 'small server/upsized workstation' market.

Previously Intel had the Xeon E/W series, chips like the W-1290P, which was basically the same as the Core i series but with official ECC support. But Intel did not release an equivalent to that for 12th/13th gen chips. And in some cases servers are unaware of the heterogenous core architecture; ESXi in particular has a fit over it.

AMD on the other hand has essentially never served this market at all. They have the EPYC 3000 series, which in addition to being embedded has not been updated in a while, and then you jump all the way up tot he EPYC 7000/9000 series of chips. They don't have a use where essentially a Ryzen CPU is dropped into a 'server' like environment; the closest they get is Ryzen Pro and it still does not have a 'server' type platform. The closest you really get is the ASRock Rack boards like the X570D4U-2L2T, which attempts to marry a server platform to the Ryzen CPU. Patrick also took a look at one of their servers based on the B650/Ryzen 7000 board as well. They work well, but a single vendor does not an ecosystem make. Supermicro is building some server stuff based on Ryzen, but it is a bit more specialized.

In my opinion - and Patrick may completely disagree - the 'small server' market is essentially underserved. Perhaps it is a very small market, but my day job has me working with a bunch of small businesses that don't need a 64 core EPYC system, and in fact big core counts would harm them because of the way core counts get tied into licensing in many cases. And even if you buy a big Xeon Scalable or EPYC server and just put one of their lower-end chips in it, lots of the lower-end chips suffer on the single-threaded performance when compared to their desktop counterpart.
 

cdru

Member
Oct 27, 2018
44
32
18
I was referring to MY system specifically, and indeed it is running Server 2022.
You were able to get it fully running under Server 2022? Everything recognized in device manager?

It's been some time since I was setting up my system, but I could have swore I had unexplained stability issues just like the FAQ entry described. This was several bios versions ago when they just started supporting the 13th gen CPUs.
 

cdru

Member
Oct 27, 2018
44
32
18
cdru could you show us IOMMU groups?
Here you go. I believe Group 15, 16, and 17 are the only items that would be unique to my system and are my HBA and two NVME drives. Everything else is either part of the board or related to the i7-12700K CPU I'm using.

Code:
IOMMU Group 0 00:00.0 Host bridge [0600]: Intel Corporation 12th Gen Core Processor Host Bridge/DRAM Registers [8086:4668] (rev 02)
IOMMU Group 1 00:01.0 PCI bridge [0604]: Intel Corporation 12th Gen Core Processor PCI Express x16 Controller #1 [8086:460d] (rev 02)
IOMMU Group 2 00:02.0 VGA compatible controller [0300]: Intel Corporation AlderLake-S GT1 [8086:4680] (rev 0c)
IOMMU Group 3 00:06.0 PCI bridge [0604]: Intel Corporation 12th Gen Core Processor PCI Express x4 Controller #0 [8086:464d] (rev 02)
IOMMU Group 4 00:0a.0 Signal processing controller [1180]: Intel Corporation Platform Monitoring Technology [8086:467d] (rev 01)
IOMMU Group 5 00:14.0 USB controller [0c03]: Intel Corporation Alder Lake-S PCH USB 3.2 Gen 2x2 XHCI Controller [8086:7ae0] (rev 11)
IOMMU Group 5 00:14.2 RAM memory [0500]: Intel Corporation Alder Lake-S PCH Shared SRAM [8086:7aa7] (rev 11)
IOMMU Group 6 00:15.0 Serial bus controller [0c80]: Intel Corporation Alder Lake-S PCH Serial IO I2C Controller #0 [8086:7acc] (rev 11)
IOMMU Group 6 00:15.1 Serial bus controller [0c80]: Intel Corporation Alder Lake-S PCH Serial IO I2C Controller #1 [8086:7acd] (rev 11)
IOMMU Group 7 00:16.0 Communication controller [0780]: Intel Corporation Alder Lake-S PCH HECI Controller #1 [8086:7ae8] (rev 11)
IOMMU Group 7 00:16.3 Serial controller [0700]: Intel Corporation Device [8086:7aeb] (rev 11)
IOMMU Group 8 00:17.0 SATA controller [0106]: Intel Corporation Alder Lake-S PCH SATA Controller [AHCI Mode] [8086:7ae2] (rev 11)
IOMMU Group 9 00:1b.0 PCI bridge [0604]: Intel Corporation Device [8086:7ac0] (rev 11)
IOMMU Group 10 00:1b.4 PCI bridge [0604]: Intel Corporation Device [8086:7ac4] (rev 11)
IOMMU Group 11 00:1c.0 PCI bridge [0604]: Intel Corporation Alder Lake-S PCH PCI Express Root Port #1 [8086:7ab8] (rev 11)
IOMMU Group 12 00:1c.1 PCI bridge [0604]: Intel Corporation Alder Lake-S PCH PCI Express Root Port #2 [8086:7ab9] (rev 11)
IOMMU Group 13 00:1c.3 PCI bridge [0604]: Intel Corporation Device [8086:7abb] (rev 11)
IOMMU Group 14 00:1f.0 ISA bridge [0601]: Intel Corporation Device [8086:7a88] (rev 11)
IOMMU Group 14 00:1f.3 Audio device [0403]: Intel Corporation Alder Lake-S HD Audio Controller [8086:7ad0] (rev 11)
IOMMU Group 14 00:1f.4 SMBus [0c05]: Intel Corporation Alder Lake-S PCH SMBus Controller [8086:7aa3] (rev 11)
IOMMU Group 14 00:1f.5 Serial bus controller [0c80]: Intel Corporation Alder Lake-S PCH SPI Controller [8086:7aa4] (rev 11)
IOMMU Group 14 00:1f.6 Ethernet controller [0200]: Intel Corporation Ethernet Connection (17) I219-LM [8086:1a1c] (rev 11)
IOMMU Group 15 01:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
IOMMU Group 16 02:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981/PM983 [144d:a808]
IOMMU Group 17 04:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/980PRO [144d:a80a]
IOMMU Group 18 05:00.0 PCI bridge [0604]: Integrated Technology Express, Inc. IT8893E PCIe to PCI Bridge [1283:8893] (rev 41)
IOMMU Group 19 07:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I225-LM [8086:15f2] (rev 03)
IOMMU Group 20 08:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 06)
IOMMU Group 20 09:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 52)
 
  • Like
Reactions: rtech

WillTaillac

Member
Feb 28, 2020
71
41
18
You were able to get it fully running under Server 2022? Everything recognized in device manager?

It's been some time since I was setting up my system, but I could have swore I had unexplained stability issues just like the FAQ entry described. This was several bios versions ago when they just started supporting the 13th gen CPUs.
There are two unknown devices in device manager, both referring to Intel's ME, which I couldn't give two craps about. I did not even attempt to install drivers; perhaps they would have worked fine.
1693538015245.png
As for stability, this is a system we do not allow to reboot very often due to its role. It's got a 98 day uptime for the moment. This one is running a 12th gen CPU and is the one I used to write the initial review.

I've built a couple more systems based on this board, including one running a 13700, but that system is running ESXi so there is no device manager to look at.