1U Supermicro Server 6x 10GBE RJ45 X10SLH-LN6TF LGA 1150 H3 X10SLH-N6-ST031

[Bert]

Running ESXi 7.0 U1 between 2 VM with a VyOS Router between them and x540-AT2 10GB nics, my servers are also the same as this 1U, running sys-6028u-tr4+, might pick one of theses U1 for FW/Routing purpose also running ESXi.

[root@iperf02 ~]# iperf3 -c x.x.x.x
Connecting to host 10.0.1.185, port 5201
[ 4] local x.x.x.x port 52064 connected to x.x.x.x port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 1.01 GBytes 8.70 Gbits/sec 147 789 KBytes
[ 4] 1.00-2.00 sec 1.10 GBytes 9.42 Gbits/sec 0 1.50 MBytes
[ 4] 2.00-3.00 sec 1.10 GBytes 9.42 Gbits/sec 0 1.97 MBytes
[ 4] 3.00-4.00 sec 1.09 GBytes 9.41 Gbits/sec 0 2.36 MBytes
[ 4] 4.00-5.00 sec 1.09 GBytes 9.41 Gbits/sec 474 1.57 MBytes
[ 4] 5.00-6.00 sec 1.05 GBytes 9.04 Gbits/sec 777 1.23 MBytes
[ 4] 6.00-7.00 sec 1.10 GBytes 9.42 Gbits/sec 204 953 KBytes
[ 4] 7.00-8.00 sec 1.07 GBytes 9.22 Gbits/sec 0 1.57 MBytes
[ 4] 8.00-9.00 sec 1.09 GBytes 9.39 Gbits/sec 0 2.02 MBytes
[ 4] 9.00-10.00 sec 1.09 GBytes 9.35 Gbits/sec 1356 1.44 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 10.8 GBytes 9.28 Gbits/sec 2958 sender
[ 4] 0.00-10.00 sec 10.8 GBytes 9.27 Gbits/sec receiver

iperf Done.

This is awesome but I am still hoping to get the configuration how to configure the bridges. Is this Vyos 1.1.8 or 1.3?



@Marsh , perhaps you can share your config?

I also want to ask which one would be better:

1. Use VYOS as full switch and then use pfsense and/or Windows RRAS as the router
2. Use VYOS as switch + router and then use nothing else.

The second option seems scary as it seems like using VYOS as home router could be quite a challenge as it may be missing many firewall/security features.

 

[Marsh]

My test bed hardware ( CPU RAM ) and software config is in post #151
result in post #161 and vyos config is in #162

vyos version is 1.2.x

If you have questions, I am happy to answer.

 

[Marsh]

My raw iperf3 result test notes

 

[Marsh]

My 2 parts of vyos config file, from my test notes
First part is NAT router ,
second part is vyos bridge as switch config

 

[Marsh]

The second option seems scary as it seems like using VYOS as home router could be quite a challenge as it may be missing many firewall/security features.

At one time , many years ago, vyos and Ubiquiti firewall Router shared similar code base.
vYos is a very capable firewall router, it is intimating to configure the firewall rules properly.
There are many examples of firewall / router if you search it.

One function is missing , DNS and DHCP tight integration.

I run vyos virtual router in all my internal network.

 

[Bert]

Thank you very much, @Marsh! Your help will be greatly appreciated.

I tried to use the configuration at post but I am not able to get the router functionality working with the bridge (I decided to use VYOS as the router to keep things simple).

I was able to make the VYOS working as router before adding the switch configuration. I am running VYOS on VM but my devices are physical, hence all hypernet switches are external. I attached my script/configuration. I am not sure why setting the interface on bridge does not let devices connected to the ports taking address and connectivity. Other than one port, none of the ports on the switch is giving IP to the connected devices. Eth1 is the only one giving IP but routing is still not working hence there is no internet connectivity. Same VYOS set up was working fine before setting up the bridge.

 

[Bert]

I followed the instructions given here:

.

Pretty much my conf is exactly same other than the management port for me to ssh. I am pretty sure Hyper-V is configured correctly as it worked when I was running VYOS as router. Now, I expect to see the computer connected to one of the ports have received IP from the home router and indicate internet connectivity but none of them is happening. Am I missing something obvious with VYOS conf?

 

[Zombielinux]

Followup questions after reading this thread:

1) Can the individual pairs of nics be turned off (maybe via powertop?) I really only need one or two (for now)

2) What chassis is this? From seeing individual pictures, it looks like a CSE815. If that's the case, I'd be interested to see if an optical drive kit would fit in it.

I am looking to make a low power/maintenance SAS to iSCSI target server, and if this works, it would fit the bill.

 

[EasyRhino]

from my old post #183, you can disable NICs (pairs) with jumpers. When I disabled all 3 it only reduced power consumption from idle 60W to 50W.

 

[Medikherb]

Has anyone been able to get a E3 V4 cpu to work?

 

[EasyRhino]

Has anyone been able to get a E3 V4 cpu to work?

I believe the consensus is no

 

[Medikherb]

Well then a E3-1281-V3 it is.

 

[Fritz]

Does Supermicro say v4 is compatible?

 

[zanechua]

Would just like to mention that the IO layout is the same as various other SM boards.

The part number for the IO shield is MCP-260-00084-0N.

Supermicro IO Shield For 2U+ Chassis (MCP-260-00084-0N)

Standard Design For mATX, ATX, and eATX Motherboards Compatible With Various A1 and X10 Motherboards High Quality Anti-Rust Material Supermicro Certified

store.supermicro.com

 

[Bert]

The price for motherboard is now $78. It looks like they had a lot of them.

 

[EasyRhino]

Would just like to mention that the IO layout is the same as various other SM boards.

The part number for the IO shield is MCP-260-00084-0N.

Supermicro IO Shield For 2U+ Chassis (MCP-260-00084-0N)

Standard Design For mATX, ATX, and eATX Motherboards Compatible With Various A1 and X10 Motherboards High Quality Anti-Rust Material Supermicro Certified

store.supermicro.com

Oh that's awesome because the bundled io shield flops around a atx case

 

[eduncan911]

Anyone need 32 of them?

Lot Of 32 Supermicro 1U Firewall X10SLH-N6-ST031-SV-LOT OF 3

 

[Fritz]

Anyone need 32 of them?

Lot Of 32 Supermicro 1U Firewall X10SLH-N6-ST031-SV-LOT OF 3

I suppose, if one has a need.

 

[mattias8]

I received one of these, installed a CPU and RAM. No beeps. But also no VGA signal.

Checked JPG1 jumper and it's on 1-2 (enabled).

Seller reset the IPMI user/pass but didn't write down the IP address.
If I can't get into the BIOS, do I have to run a DHCP server and provide it an IP address?

Is there a default IP address for the IPMI on these machines?

Edit: I tried 192.168.0.1

Edit 2: I also tried running a DHCP server in case the BMC was looking for an IP. That didn't work either.

 

[eduncan911]

KB and Monitor directly connected is your best bet. Ignore the IPMI.

Did you happen to reset the bios? Remove the cmos battery (if there is one)? There should also be a jumper to reset the BIOS (check the manual).


After resetting the bios, VGA output should be working. If not, it could be a faulty board.

See if you can get some beeps out of it. Remove the RAM, or CPU, and try to boot. You should get beeps.

If no beeps, then the last thing to consider would be a failed flash or bad board. For a failed flash, you can recover the bios:

http://www.supermicro.com/manuals/other/UEFI_BIOS_Recovery.pdf

Besides that... Board would be dead, and contact the seller. Something this big and heavy, the seller doesn't want you to send back - as they would have to pay shipping.