1U Supermicro Server 6x 10GBE RJ45 X10SLH-LN6TF LGA 1150 H3 X10SLH-N6-ST031

[joellinn]

Could have told you . There is a sticker on the case that says "Softlayer, IBM". It's also written in the thread someplace.

 

[Churchill]

Could have told you . There is a sticker on the case that says "Softlayer, IBM". It's also written in the thread someplace.

I was scanning through the thread and saw the "Well the vendor was going to make us pay for the unlock but we figured it out.." part and then skipped to the end.

Reading comprehension is not 100% my thing.

Also, did you hear back from Opnsense about the speed issue? They released 22.1.6 maybe there's some tweaks in it? I saw the thread and Franco hasn't commented sadly

 

[joellinn]

Not really thread there is pretty much dead. Like this one . Might actually switch to OpenWrt. Bit less features but it usually just works with no tuning

 

[Churchill]

Not really thread there is pretty much dead. Like this one . Might actually switch to OpenWrt. Bit less features but it usually just works with no tuning

I'd be curious how you shoehorned OpenWRT on the server.

 

[EasyRhino]

I dimly recall trying to run openwrt on it, and failing to get it to install. (it might have been attempting in a VM, or maybe bare metal, can't remember any more)

 

[Churchill]

Here is the issue that folks are tracking for the opnsense 10gbe issue:

High Packet Loss/CRC errors for Tx on axgbe (DEC2750/OPNsense 22.1)

High Packet Loss/CRC errors for Tx on axgbe (DEC2750/OPNsense 22.1)

forum.opnsense.org

 

[petersnows]

View attachment 22282
Registered just off this thread, great community here, have a build in progress used a lot of the information here to get up and running. It’s functional, gotta make a top for it though, it’s part of a bigger themed project so you’ll have to excuse some oddities for looks

planning a right up once it’s a bit more complete, quite the learning experience

Great Build.
Can you share a bit more ?
Case ?
Fans ?

Thanks

 

[Churchill]

@joellinn did you get any update with your opnsense issue?

 

[DAMatson]

Good evening folks,

I too have found this SuperMicro system to be a good deal, most notably for the numerous 10G ports. I have a 5GBe connection from AT&T, but when I connect the 10G port on the motherboard to the 5G of the AT&T Router (Humax BGW320-500), the most I see on a connection basis (as reported by pfSense) is 1000baseT.

I've tried the pciconf -lv command and have this output, which I believe indicates that the driver for the Intel NIC is loaded properly at least (but I could be wrong about this):

ix0@pci0:4:0:0: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = 'Ethernet Controller 10-Gigabit X540-AT2'
class = network
subclass = ethernet
ix1@pci0:4:0:1: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = 'Ethernet Controller 10-Gigabit X540-AT2'
class = network
subclass = ethernet
ix2@pci0:5:0:0: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = 'Ethernet Controller 10-Gigabit X540-AT2'
class = network
subclass = ethernet
ix3@pci0:5:0:1: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = 'Ethernet Controller 10-Gigabit X540-AT2'
class = network
subclass = ethernet
ix4@pci0:6:0:0: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = 'Ethernet Controller 10-Gigabit X540-AT2'
class = network
subclass = ethernet
ix5@pci0:6:0:1: class=0x020000 card=0x152815d9 chip=0x15288086 rev=0x01 hdr=0x00
vendor = 'Intel Corporation'
device = 'Ethernet Controller 10-Gigabit X540-AT2'
class = network
subclass = ethernet

I have selected ix0 for the WAN, and ix1 for the LAN. However, I have tried other port combinations and I'm having the same problem on each of them.


Speed and Duplex
In the "Speed and Duplex" setting under each interface, it does reflect that 10Gbase-T media "is Supported by this interface", which again supports the theory that it is correctly configured. However, when I do select to hardcode the 10Gbase-T setting, it still does not change the status page:

Status > Dashboard
WAN 1000baseT <full-duplex,rxpause,txpause> xxx.xx.xxx.xx
LAN 1000baseT <full-duplex,rxpause,txpause> 192.168.1.1

Speedtest (AT&T Internal)
The AT&T Router has been testing the connection on a recurring basis, so I will take this at face value until we can prove otherwise:
Upstream 4945.743
Downstream 5432.466

Speedtest
I took the liberty of installing the CLI version of Speedtest on the pfSense box as nothing more than an indicator of whether or not I was truly connecting at a speed greater than 2+ or 3+ GBps, it unfortunately reflects that I am still sitting at sub-gigabit speeds:

Retrieving speedtest.net configuration...
Testing from AT&T U-verse (xxx.xx.xxx.xx)...
Retrieving speedtest.net server list...
Selecting best server based on ping...
Hosted by Open10G (Emeryville, CA) [114.99 km]: 17.479 ms
Testing download speed................................................................................
Download: 866.67 Mbit/s
Testing upload speed......................................................................................................
Upload: 784.22 Mbit/s

I'm relatively new to pfSense and the various *nix flavors, so I don't really know the best way to troubleshoot this further, so hoping someone here can assist my newb self...

Lastly, I have attempted to access the BIOS on my system via DEL button during POST, but it never gains access. I am hoping there is an easy fix, as this doesn't feel like a defective board.

 

[EasyRhino]

yep. the x540 ports are not compatible with multi-gig. They can't do 2.5gb or 5gb. Only 1gb and 10gb.

 

[DAMatson]

Wow. Thank you for that brutal but honest solution. My bad for not asking the right question of the seller.

Ok, so then does anyone have a system that has two "multi-gigabit" compatible ports rated up to 5GB each that they can recommend?

 

[cb0r]

That is exactly what brought me to this thread. I have AT&T 5G install scheduled for next week and my current router (netgate 2100) has 2.5G max port. I need to find a solution with 2 x 5gig compatible ports as well.

 

[Sean Ho]

One workaround folks here have found is to pass it through a 10GbE switch that can sync 2.5/5GbaseT. E.g., CRS305 with ipolex SFP+/10GbaseT transceivers, or perhaps Netgear XS505M, MS510TX etc.

 

[cb0r]

Thanks Sean! I had not thought of using a switch. I have a QSW-M1208-8C switch that I can use at least as temporary solution.
I saw a youtube vid where a guy was using a QSW-308-1C switch to convert RJ45 to Fiber to avoid using the RJ45>SFP+ transceiver to connect to his UDM-Pro. But, it had not occured to me that I could do the same for my issue.

 

[petersnows]

I thought I'd follow up with fun pics of my janky router build.

Do you know the reference of your case ?
I am trying to buy a case for this MB, and your seams to be the smallest one possible.
Thanks

 

[lamune]

Does anyone have the IPMI firmware image or at least the version that is known to work on the X10SLH-N6-ST031?

I updated the firmware and it doesn't work- no sensors detected causing the the board to go into overheat mode.

Edit - actually never mind - it's now clear this board is just broken and has nothing to do with the firmware version.

 

[zedalert]

This week I finally assembled and tested the router based on this mobo (inside case from an old Asus RS100), with an additional 6x1G NIC called Silicom PEG6 and 2x1G+2x10G combo NIC called IBM EN0T. Everything seems fine, pushing 10G through two additional fiber ports consumes nearly 1% of CPU (since almost everything is offloaded), so theoretically it could handle about 180G duplex speed across all its ports in L2 mode.

So everything seems fine except these X540 NICs do not support speeds between 1G and 10G. I only found out this today, after I purchased some 2.5G USB3 NICs to run over my existing Cat.5e cables...

Anyway I'm happy to have this little puppy, since its price was almost like any usual old mobo, but it has some advantages.

 

[EasyRhino]

Do you know the reference of your case ?
I am trying to buy a case for this MB, and your seams to be the smallest one possible.
Thanks

someone had asked me in DM about it. The brand isn't marked, and I bought mine used from a guy locally. Image searching led me to these similar cases (which are no longer in stock) but maybe give an idea.

Amazon.in: Buy MFBK400 - Micro Fly Black Micro ATX case with V400PSU, EXT 2-5.25", 1-3.5", int 2-3.5" - ULT33114 Online at Low Prices in India | Ultra Products Reviews & Ratings

Amazon.com: Ultra ULT33117 MicroFly MicroATX Desktop PC Case with Clear Side (Black) : Electronics


I've also been told that a fractal node 804 should fit a board this long but don't think anyone's tried it.

 

[sergi0]

Hi,
I am interested in this board coupled with a E5-1220L v3 to minimise power consumption. I plan to use it as a simple FW with openbsd.
I have no use of the 10gb speed because my Internet access is only 1gb, but I have use of the 6 ports. I don't mind the extra power as the setup will be very basic (ram, satadom and cpu).
Does anyone have a mobo reference that has 4 ethernet ports with the same kind of cpu suport ?
thanks,
S.

 

[EasyRhino]

any supermicro with the -LN<number> has extra networking build in. for instance:

X10SLM+-LN4F | Motherboards | Products | Super Micro Computer, Inc.

this particular board, the LN6TF, is of course special, was made for a certain manufacturer, and not a normally listed product.