1U Supermicro Server 6x 10GBE RJ45 X10SLH-LN6TF LGA 1150 H3 X10SLH-N6-ST031

[Marsh]

Bumping to see if anyone has tried using this as a glorified Ethernet switch? If so how has it worked for you? Any setup or usage problems?

See my hardware setup in post #151

3 machines , using proxmox as OS , one machine hosting virtual vyos switch ,
2 other proxmox machines hosting 2 Ubuntu vm.

buster1 as iperf3 client to server 10.222.223.200
[SUM] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec
[SUM] 0.00-10.00 sec 10.8 GBytes 9.29 Gbits/sec
[SUM] 0.00-10.00 sec 10.8 GBytes 9.28 Gbits/sec

ran iperf 3 times

 

[Marsh]

VyOS Switch config

show interface

configure
delete interfaces eth eth1 address
delete interfaces eth eth1 description
delete interfaces eth eth2 address
delete interfaces eth eth2 description
commit


Creating the bridge

set interfaces bridge br0

# set interfaces bridge br0 address 10.10.10.245/24

set interfaces bridge br0 address 10.222.222.1/24
set interfaces bridge br0 description 'bridge 1'

compare
commit
save
exit

Assign interfaces to the bridge
configure

set interfaces ethernet eth1 bridge-group bridge br0
set interfaces ethernet eth2 bridge-group bridge br0
set interfaces eth eth1 description 'br0 10gb member'
set interfaces eth eth2 description 'br0 10gb member'

set interfaces eth eth2 mtu 9000
compare
commit
save

 

[EasyRhino]

Any idea what the latency is? Any significant difference in regular usage?

 

[Marsh]

I am using a regular 10gbe switch.
The virtual vyos performance is a bit of nice surprise , I'll explore it further when I have time.

What tests you have in mind?

 

[EasyRhino]

I have no idea. Maybe basic ping test, maybe subjective feelings of latency even doing something like remote desktop, or maybe performance over remote file shared like large transfers or a database or something.

Oh and.cpu utilization.during iperf3!

 

[Marsh]

Post #151 , I posted CPU usage , although it is for routing.

I did ping , from memory , it is sub 1ms.

I could run qperf test with the virtual vyos switch later.

 

[lst3245]

I have an e3 1285l v4. After installation, the black screen cannot be turned on. Can anyone modify the bios again to support the v4 series of CPUs?

Can confirm. Same CPU and the board keeps powering on and off, no POST or video output. E3-1245 v3 works though. Anyone had success with v4 xeons?

Also, I am wondering if the board supports SR-IOV. I can't find anything in the bios though. It would be nice to be able to utilize SR-IOV on those X540 nic. Any help would be greatly appreciated.

 

[chris heyworth]

Hello all, i have received this board from the seller on the first page, and am using it with an Intel i5-4570S and 12gb RAM.
I have installed Win 10 Pro on SSD and installed a pcie network card to give it internet access/remote desktop and then bridged all 6 10GBe NIC's.

with a mapped NVME drive I get the attached speeds using CrystalDiskMark

I was expecting mush slower than this.

 

[chris heyworth]

transfer of an iso from server 2019 to windows 10 desktop tops out at about 980MB/s, and 870MB/s the other way.

Do i keep this setup or go back to a Netgear XS 10GBe switch?

 

[lst3245]

I have figured it out. The board does support SR-IOV! PCI passthrough must be disabled first for that nic to enable SR-IOV in esxi. I passed through the virtual functions to two different VMs and funny enough, I was able to get over 10Gbps with iperf! There must be some interesting stuff done by the X540. The switching is completely offloaded to the X540 and no CPU usage on the vSwitch in esxi! Awesome!

 

[hive]

Does the modded BIOS with NVMe boot support include support for Xeon E3V4 chips?

 

[hive]

Mine came a few weeks ago and realized I couldn't boot from the NVME addon card - had the same problem with an X10DRI until I learnt how to mod the SMC bios.

Have included the modded 3.2 Bios from Bluefox. You will need to reset CMOS after install - did mine from a Rufus FreeDos USB.

As usual I accept no responsibility ... yada yada ... use at your own risk

Dropbox - File Deleted

Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. Never email yourself a file again!

www.dropbox.com

@BlueFox @awilson29 Do you know if this modded BIOS supports V4 Xeon E3 processors like the E3-1278LV4 or E3-1265LV4?

 

[BlueFox]

@BlueFox Do you know if this modded BIOS supports V4 Xeon E3 processors like the E3-1278LV4 or E3-1265LV4?

Regrettably I can't tell you. I never wound up purchasing one of these motherboards and have only been hosting the modded BIOS for the community. I've not actually tested it.

 

[hive]

Regrettably I can't tell you. I never wound up purchasing one of these motherboards and have only been hosting the modded BIOS for the community. I've not actually tested it.

@BlueFox Do you believe that the mods made to the BIOS should support V4 CPUs, but just have not tested that?

 

[lst3245]

@BlueFox Do you believe that the mods made to the BIOS should support V4 CPUs, but just have not tested that?

I flashed that modded BIOS and tried an E3-1285L v4. Like I said in a previous post, no luck. A v3 xeon works though. But your CPU is different from mine, so YMMV.

 

[EasyRhino]

hey has anyone tried installing this board in a regular desktop/tower case? It seems like it's microatx in width, but extra long EATX/SSI-EEB in length. Not sure what it would even fit in.

 

[lst3245]

hey has anyone tried installing this board in a regular desktop/tower case? It seems like it's microatx in width, but extra long EATX/SSI-EEB in length. Not sure what it would even fit in.

haha I once have the same problem! The board is just a rotated ATX size, it fits standard MATX holes perfectly

In case you are not sure, the red dots are standard MATX holes, and the red square is the standard MATX size.
For me, I have to remove the HDD cage and it fits perfectly!

 

[EasyRhino]

thanks for drawing in the circles on th emount points.

so maybe I find a really long matx case.... but it will be hard to search on, because it's like matx cases advertise if they have an extra 3 inches of motherboard mounting space.

but I do have a couple of plastic standoffs for motherboards already so those could come in handy when I exceed the regular matx mounting spots....

 

[lst3245]

thanks for drawing in the circles on th emount points.

so maybe I find a really long matx case.... but it will be hard to search on, because it's like matx cases advertise if they have an extra 3 inches of motherboard mounting space.

but I do have a couple of plastic standoffs for motherboards already so those could come in handy when I exceed the regular matx mounting spots....

The board really does not exceed the width of MATX that much, only about 6cm. The dimension of the board is 24*30 cm and many modern case will fit it. My case is the thermaltake S100, which have plenty space left. I just leave the far right mounting hole unscrewed. You could use your plastic standoffs as well.

 

[Bert]

I flashed that modded BIOS and tried an E3-1285L v4. Like I said in a previous post, no luck. A v3 xeon works though. But your CPU is different from mine, so YMMV.

With a xeon CPU, can I use ECC DDR4?