1U Supermicro Server 6x 10GBE RJ45 X10SLH-LN6TF LGA 1150 H3 X10SLH-N6-ST031

Marsh

Moderator
May 12, 2013
2,566
1,411
113
Very encouraging network performance using these boards.
using Proxmox and virtual vyos 1.2.x router ,
Getting 9 Gbits/sec routing between 2 subnet.

10G Network direct connect between 2 X10SLH machines , no switch
1 machine has E3-1240v3 , 1 machine has E3-1226v3
Proxmox6.2 hosting virtual vyos router ( LAN1 10.222.222.1 <=> LAN2 10.222.223.1 )
all vm are 2vcpu , 1gb ram

vyos 1.2.x VM in proxmox host X10SLH E3-1220v3 16gb ram
CPU 28%

ubuntu 18.0.4 buster1 and buster2 vm in proxmox host X10SLH E3-1240v3 16gb ram
CPU 26%
buster1 as iperf3 client to server 10.222.223.200
[SUM] 0.00-10.00 sec 10.6 GBytes 9.07 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.6 GBytes 9.10 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.6 GBytes 9.09 Gbits/sec receiver

buster2 as iperf3 client to server 10.222.222.200
[SUM] 0.00-10.00 sec 10.6 GBytes 9.08 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.7 GBytes 9.16 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.6 GBytes 9.10 Gbits/sec receiver

Ran iperf3 3 times

IP
buster1 = 10.222.222.200
buster2 = 10.222.223.200

I may not even want to test on baremetal , the number looks great.
 
Last edited:
  • Like
Reactions: Markess

UXSServers

New Member
Mar 27, 2019
9
1
3
Hello this is Justin from Unix Surplus, we have the BIOS and unlock all the boards and systems for you guys now, you can see we have updated all the listings it let me know if you have any questions, TO THE ADMINS DELETE MY POST IF NOT ALLOWED to put the links. thanks don't want to impose.

 
  • Like
Reactions: Tyrant82

PigLover

Moderator
Jan 26, 2011
3,086
1,403
113
Hello this is Justin from Unix Surplus, we have the BIOS and unlock all the boards and systems for you guys now, you can see we have updated all the listings it let me know if you have any questions, TO THE ADMINS DELETE MY POST IF NOT ALLOWED to put the links. thanks don't want to impose.

Welcome to the forums, Justin. Normally posts with links to eBay auctions from commercial sellers are discouraged - but in the context of this item and the long discussion about it here I think it is just fine. Thank you for taking the time to share status with us.
 
  • Like
Reactions: abq

mervincm

Active Member
Jun 18, 2014
159
39
28
@BlueFox

NOT 10GbE
SuperMicro X10SLM-F

Most H3 socket motherboards don't have 10GbE built in. I would say native boards that have 10GbE or Fiber on an H3 socket are less than my fingers on one hand in a semi common form factor.

A home router at my house is not idle in the slightest, Mother-In-Law streams TV just to have background noise I swear... and she's constantly downloading something that she shouldn't. She thinks she needs a VPN to play her games on her iPhone so that she won't get a virus but gets scammed into buying the apps. So power is based off of a processor with load even if its not all the time. Plus Copper is easier to mate to existing networking even though I have a TurboIron 24x switch the fiber patch or copper converter is still 30-40 bucks. 6 copper 10GbE is just right for future proofing and if I buy 4 copper Converters for the 10GbE its about paid for itself to buy the Server board in this thread..

Buying a second one to play with to have one at my parents would just be for learning and setting up Site to Site.

Marsh

Pitting 4c4t against 4c8T both are close in watts so maybe not a power difference. Both have 8mb L3 which I find interesting wouldn't think a 4c4t would have that cache size. But maybe the 8mb Is standard on most E3 v3's.
pfsense on mine runs in lowest power modes (800 Mhz) virtually always, and my 1 /5 /15 min CPU usage is often under 1% when I check. Idle describes it to me :) I have 940 mbps fiber based internet.

Blue fox has it right IMO, idle power consumption is what really matters here and most CPU in the same generation idle at the same power usage.
 
  • Like
Reactions: Fritz

JanCerny

Member
Nov 25, 2017
82
22
8
Czech Republic
One thing I'm dying to know is whether that PCIe slot with the riser supports bifurcation.... can you check quickly? Cheers
The Intel spec for Gen 8 Chipsets (this board should have a C226) shows the "server" chipsets (C222,C224, & C226), plus Z87, have support for bifurcation of the PCIE Express Graphics (PEG) slot (the x16 slot). Supported configurations are 1x16, 2x8, 1x8, or 2x4. For the Consumer/Business chipsets this slot is fixed at 1x16. See page 56: https://www.intel.com/content/dam/w...datasheets/8-series-chipset-pch-datasheet.pdf

I believe that the motherboard may already have this slot fixed at x8 (to have enough lanes for a second slot to be x8 electrically?). So, presumably, splittng it to 2x4 would be the easiest option, assuming it can be done.

As @techtoys menitions, knowing if its supported in the hardware itself is the first step, I think you're good there, if you stick to the PEG slot. Unlike the C6xx chipsets that support bifurcation of multiple slots, the C22x only support bifuration of the one slot.

As for a guide on modifying the BIOS to enable bifuration: I've not seen anything specific to enabling bifurcation on the C22x chipsets, but I've seen this guide on the Win-Raid forums, which is focused more on X99/C6xx, but may be of help.

BIOS Modding Guides and Problems » [Guide] - How to Bifurcate a PCI-E slot

There's an NVME boot BIOS mod thread on the forums here that also mentions bifurcation I believe. Its for the prior generation chipset, but has some good information on BIOS mods in general: https://forums.servethehome.com/index.php?threads/nvme-boot-with-supermicro-x9da7-x9dri-f.13245/

There's a Win-Raid thread mentioned in the post above that, while its focused on BIOS mods for NVME booting, is very detailed on the BIOS mod process and may be useful in understanding the process as a whole:

[Guide] How to get full NVMe support for all Systems with an AMI UEFI BIOS
No, you can't enable bifurcation, because 16 CPUs lanes are split by PLX 8747 multiplexer and x4x4x8x8x8 combination is not mentioned in the product brief.
X10SLH-LN6TF-Block-Diagram.png
As I know, Haswell generation supports x8x8 or x8x4x4 bifurcation options (designed for 2-way SLI or 3-way CrossFire). However cheap multiplexers have higher latency than PEX 8747.
Gigabyte GA-Z97X-Game Plus (rev. 1.0) - diagram.png

I can confirm that I, too, am having problems with my HBA card. My LSI 9207-8i just wouldn't show up at all.
Try to disable "PCI Slot SMB Enable" (JI2C1/JI2C2). cc: @Medikherb
 
Last edited:

EasyRhino

Active Member
Aug 6, 2019
293
173
43
Bumping to see if anyone has tried using this as a glorified Ethernet switch? If so how has it worked for you? Any setup or usage problems?
 

Marsh

Moderator
May 12, 2013
2,566
1,411
113
Bumping to see if anyone has tried using this as a glorified Ethernet switch? If so how has it worked for you? Any setup or usage problems?
See my hardware setup in post #151

3 machines , using proxmox as OS , one machine hosting virtual vyos switch ,
2 other proxmox machines hosting 2 Ubuntu vm.

buster1 as iperf3 client to server 10.222.223.200
[SUM] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec
[SUM] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec
[SUM] 0.00-10.00 sec 10.8 GBytes 9.28 Gbits/sec

ran iperf 3 times
 
  • Like
Reactions: Bert

Marsh

Moderator
May 12, 2013
2,566
1,411
113
VyOS Switch config

show interface

configure
delete interfaces eth eth1 address
delete interfaces eth eth1 description
delete interfaces eth eth2 address
delete interfaces eth eth2 description
commit


Creating the bridge

set interfaces bridge br0

# set interfaces bridge br0 address 10.10.10.245/24

set interfaces bridge br0 address 10.222.222.1/24
set interfaces bridge br0 description 'bridge 1'

compare
commit
save
exit

Assign interfaces to the bridge
configure

set interfaces ethernet eth1 bridge-group bridge br0
set interfaces ethernet eth2 bridge-group bridge br0
set interfaces eth eth1 description 'br0 10gb member'
set interfaces eth eth2 description 'br0 10gb member'

set interfaces eth eth2 mtu 9000
compare
commit
save
 

Marsh

Moderator
May 12, 2013
2,566
1,411
113
I am using a regular 10gbe switch.
The virtual vyos performance is a bit of nice surprise , I'll explore it further when I have time.

What tests you have in mind?
 
  • Like
Reactions: Bert

EasyRhino

Active Member
Aug 6, 2019
293
173
43
I have no idea. Maybe basic ping test, maybe subjective feelings of latency even doing something like remote desktop, or maybe performance over remote file shared like large transfers or a database or something.

Oh and.cpu utilization.during iperf3!
 

Marsh

Moderator
May 12, 2013
2,566
1,411
113
Post #151 , I posted CPU usage , although it is for routing.

I did ping , from memory , it is sub 1ms.

I could run qperf test with the virtual vyos switch later.
 

lst3245

New Member
Aug 8, 2020
5
8
3
I have an e3 1285l v4. After installation, the black screen cannot be turned on. Can anyone modify the bios again to support the v4 series of CPUs?
Can confirm. Same CPU and the board keeps powering on and off, no POST or video output. E3-1245 v3 works though. Anyone had success with v4 xeons?

Also, I am wondering if the board supports SR-IOV. I can't find anything in the bios though. It would be nice to be able to utilize SR-IOV on those X540 nic. Any help would be greatly appreciated.
 
  • Like
Reactions: hexhu and Bert
Jan 24, 2020
64
23
8
Hello all, i have received this board from the seller on the first page, and am using it with an Intel i5-4570S and 12gb RAM.
I have installed Win 10 Pro on SSD and installed a pcie network card to give it internet access/remote desktop and then bridged all 6 10GBe NIC's.

with a mapped NVME drive I get the attached speeds using CrystalDiskMarkswitchspeed.jpg

I was expecting mush slower than this.
 
  • Like
Reactions: lst3245