1U Supermicro Server 6x 10GBE RJ45 X10SLH-LN6TF LGA 1150 H3 X10SLH-N6-ST031

[Medikherb]

If using IPMI to flash the bios, you only need the rom file

What about the ipmi bios its at 1.01 and firmware at 3.86 the newest for the x10sl... is 3.88

 

[Marsh]

I am not sure how to answer your question.

You download the IPMI firmware REDFISH_X10_388_20200221_unsigned.zip , unzip .
Use IPMI web interface to update the ipmi firwmare REDFISH_X10_388_20200221_unsigned.bin

Download link

X10SLH-F | Motherboards | Products | Super Micro Computer, Inc.

X10S, X10SL, X10SLH, X10SLH-F

www.supermicro.com

 

[Marsh]

Very encouraging network performance using these boards.
using Proxmox and virtual vyos 1.2.x router ,
Getting 9 Gbits/sec routing between 2 subnet.

10G Network direct connect between 2 X10SLH machines , no switch
1 machine has E3-1240v3 , 1 machine has E3-1226v3
Proxmox6.2 hosting virtual vyos router ( LAN1 10.222.222.1 <=> LAN2 10.222.223.1 )
all vm are 2vcpu , 1gb ram

vyos 1.2.x VM in proxmox host X10SLH E3-1220v3 16gb ram
CPU 28%

ubuntu 18.0.4 buster1 and buster2 vm in proxmox host X10SLH E3-1240v3 16gb ram
CPU 26%
buster1 as iperf3 client to server 10.222.223.200
[SUM] 0.00-10.00 sec 10.6 GBytes 9.07 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.6 GBytes 9.10 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.6 GBytes 9.09 Gbits/sec receiver

buster2 as iperf3 client to server 10.222.222.200
[SUM] 0.00-10.00 sec 10.6 GBytes 9.08 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.7 GBytes 9.16 Gbits/sec receiver
[SUM] 0.00-10.00 sec 10.6 GBytes 9.10 Gbits/sec receiver

Ran iperf3 3 times

IP
buster1 = 10.222.222.200
buster2 = 10.222.223.200

I may not even want to test on baremetal , the number looks great.

 

[UXSServers]

Hello this is Justin from Unix Surplus, we have the BIOS and unlock all the boards and systems for you guys now, you can see we have updated all the listings it let me know if you have any questions, TO THE ADMINS DELETE MY POST IF NOT ALLOWED to put the links. thanks don't want to impose.

x10slh-n6-st031 | eBay

 

[PigLover]

Hello this is Justin from Unix Surplus, we have the BIOS and unlock all the boards and systems for you guys now, you can see we have updated all the listings it let me know if you have any questions, TO THE ADMINS DELETE MY POST IF NOT ALLOWED to put the links. thanks don't want to impose.

x10slh-n6-st031 | eBay

Welcome to the forums, Justin. Normally posts with links to eBay auctions from commercial sellers are discouraged - but in the context of this item and the long discussion about it here I think it is just fine. Thank you for taking the time to share status with us.

 

[am45931472]

Interesting board, but it looks like it uses a PLXPEX8747 Pci E switch on it for the 10GB links.

 

[nickf1227]

Been up now using this server for about 2 weeks with no issues. Seems rock solid

 

[nickf1227]

Just dropped to 99 dollars

Supermicro 1U Firewall Server W/ X10SLH-N6-ST031-SV-X10SLH-N

www.theserverstore.com

 

[Geran]

What is the 1u IO shield part number for these?

 

[mervincm]

@BlueFox

NOT 10GbE
SuperMicro X10SLM-F

Most H3 socket motherboards don't have 10GbE built in. I would say native boards that have 10GbE or Fiber on an H3 socket are less than my fingers on one hand in a semi common form factor.

A home router at my house is not idle in the slightest, Mother-In-Law streams TV just to have background noise I swear... and she's constantly downloading something that she shouldn't. She thinks she needs a VPN to play her games on her iPhone so that she won't get a virus but gets scammed into buying the apps. So power is based off of a processor with load even if its not all the time. Plus Copper is easier to mate to existing networking even though I have a TurboIron 24x switch the fiber patch or copper converter is still 30-40 bucks. 6 copper 10GbE is just right for future proofing and if I buy 4 copper Converters for the 10GbE its about paid for itself to buy the Server board in this thread..

Buying a second one to play with to have one at my parents would just be for learning and setting up Site to Site.

Marsh

Pitting 4c4t against 4c8T both are close in watts so maybe not a power difference. Both have 8mb L3 which I find interesting wouldn't think a 4c4t would have that cache size. But maybe the 8mb Is standard on most E3 v3's.

pfsense on mine runs in lowest power modes (800 Mhz) virtually always, and my 1 /5 /15 min CPU usage is often under 1% when I check. Idle describes it to me I have 940 mbps fiber based internet.

Blue fox has it right IMO, idle power consumption is what really matters here and most CPU in the same generation idle at the same power usage.

 

[JanCerny]

One thing I'm dying to know is whether that PCIe slot with the riser supports bifurcation.... can you check quickly? Cheers

Spoiler

The Intel spec for Gen 8 Chipsets (this board should have a C226) shows the "server" chipsets (C222,C224, & C226), plus Z87, have support for bifurcation of the PCIE Express Graphics (PEG) slot (the x16 slot). Supported configurations are 1x16, 2x8, 1x8, or 2x4. For the Consumer/Business chipsets this slot is fixed at 1x16. See page 56: https://www.intel.com/content/dam/w...datasheets/8-series-chipset-pch-datasheet.pdf

I believe that the motherboard may already have this slot fixed at x8 (to have enough lanes for a second slot to be x8 electrically?). So, presumably, splittng it to 2x4 would be the easiest option, assuming it can be done.

As @techtoys menitions, knowing if its supported in the hardware itself is the first step, I think you're good there, if you stick to the PEG slot. Unlike the C6xx chipsets that support bifurcation of multiple slots, the C22x only support bifuration of the one slot.

As for a guide on modifying the BIOS to enable bifuration: I've not seen anything specific to enabling bifurcation on the C22x chipsets, but I've seen this guide on the Win-Raid forums, which is focused more on X99/C6xx, but may be of help.

BIOS Modding Guides and Problems » [Guide] - How to Bifurcate a PCI-E slot

There's an NVME boot BIOS mod thread on the forums here that also mentions bifurcation I believe. Its for the prior generation chipset, but has some good information on BIOS mods in general: https://forums.servethehome.com/index.php?threads/nvme-boot-with-supermicro-x9da7-x9dri-f.13245/

There's a Win-Raid thread mentioned in the post above that, while its focused on BIOS mods for NVME booting, is very detailed on the BIOS mod process and may be useful in understanding the process as a whole:

[Guide] How to get full NVMe support for all Systems with an AMI UEFI BIOS

No, you can't enable bifurcation, because 16 CPUs lanes are split by PLX 8747 multiplexer and x4x4x8x8x8 combination is not mentioned in the product brief.

As I know, Haswell generation supports x8x8 or x8x4x4 bifurcation options (designed for 2-way SLI or 3-way CrossFire). However cheap multiplexers have higher latency than PEX 8747.

I can confirm that I, too, am having problems with my HBA card. My LSI 9207-8i just wouldn't show up at all.

Try to disable "PCI Slot SMB Enable" (JI2C1/JI2C2). cc: @Medikherb

 

[EasyRhino]

Bumping to see if anyone has tried using this as a glorified Ethernet switch? If so how has it worked for you? Any setup or usage problems?

 

[Marsh]

Bumping to see if anyone has tried using this as a glorified Ethernet switch? If so how has it worked for you? Any setup or usage problems?

See my hardware setup in post #151

3 machines , using proxmox as OS , one machine hosting virtual vyos switch ,
2 other proxmox machines hosting 2 Ubuntu vm.

buster1 as iperf3 client to server 10.222.223.200
[SUM] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec
[SUM] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec
[SUM] 0.00-10.00 sec 10.8 GBytes 9.28 Gbits/sec

ran iperf 3 times

 

[Marsh]

VyOS Switch config

show interface

configure
delete interfaces eth eth1 address
delete interfaces eth eth1 description
delete interfaces eth eth2 address
delete interfaces eth eth2 description
commit


Creating the bridge

set interfaces bridge br0

# set interfaces bridge br0 address 10.10.10.245/24

set interfaces bridge br0 address 10.222.222.1/24
set interfaces bridge br0 description 'bridge 1'

compare
commit
save
exit

Assign interfaces to the bridge
configure

set interfaces ethernet eth1 bridge-group bridge br0
set interfaces ethernet eth2 bridge-group bridge br0
set interfaces eth eth1 description 'br0 10gb member'
set interfaces eth eth2 description 'br0 10gb member'

set interfaces eth eth2 mtu 9000
compare
commit
save

 

[EasyRhino]

Any idea what the latency is? Any significant difference in regular usage?

 

[Marsh]

I am using a regular 10gbe switch.
The virtual vyos performance is a bit of nice surprise , I'll explore it further when I have time.

What tests you have in mind?

 

[EasyRhino]

I have no idea. Maybe basic ping test, maybe subjective feelings of latency even doing something like remote desktop, or maybe performance over remote file shared like large transfers or a database or something.

Oh and.cpu utilization.during iperf3!

 

[Marsh]

Post #151 , I posted CPU usage , although it is for routing.

I did ping , from memory , it is sub 1ms.

I could run qperf test with the virtual vyos switch later.

 

[lst3245]

I have an e3 1285l v4. After installation, the black screen cannot be turned on. Can anyone modify the bios again to support the v4 series of CPUs?

Can confirm. Same CPU and the board keeps powering on and off, no POST or video output. E3-1245 v3 works though. Anyone had success with v4 xeons?

Also, I am wondering if the board supports SR-IOV. I can't find anything in the bios though. It would be nice to be able to utilize SR-IOV on those X540 nic. Any help would be greatly appreciated.

 

[chris heyworth]

Hello all, i have received this board from the seller on the first page, and am using it with an Intel i5-4570S and 12gb RAM.
I have installed Win 10 Pro on SSD and installed a pcie network card to give it internet access/remote desktop and then bridged all 6 10GBe NIC's.

with a mapped NVME drive I get the attached speeds using CrystalDiskMark

I was expecting mush slower than this.