1U Supermicro Server 6x 10GBE RJ45 X10SLH-LN6TF LGA 1150 H3 X10SLH-N6-ST031

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

BlueFox

Legendary Member Spam Hunter Extraordinaire
Oct 26, 2015
2,492
1,909
113
I don't want to derail this thread, but this Edge 3800 box seems interesting - is there any information out there on storage options, OOB management, power consumption, noise, etc for this platform?
I have one a few feet away from me with pfSense installed. What do you want to know? :)

I can create a thread on these detailing all the hardware, but it might take me a few days.
 

luckylinux

Well-Known Member
Mar 18, 2012
1,521
475
83
I have one a few feet away from me with pfSense installed. What do you want to know? :)

I can create a thread on these detailing all the hardware, but it might take me a few days.
Please do, I'm not in a hurry ;) .

I Looked quickly on eBay and it seems to be > 700 USD so WAY more expensive than I would like.

Right now my Homelab is 10gbe and WAN is barely 1gbe (more like 700mbps-800mbps), so I feel like this is way overkill.

The Supermicro X10SLL-F let alone the Supermicro X11SSL-F / Fujitsu TX1320 M3 coupled with a 10gbps NIC (Intel X710 / Intel XXV710 / Mellanox ConnectX-4 LX) should be able to handle all inter-LAN Routing without Issues. Let alone the WAN.

Fan Noise :p ?
 

BlueFox

Legendary Member Spam Hunter Extraordinaire
Oct 26, 2015
2,492
1,909
113
Please do, I'm not in a hurry ;) .

I Looked quickly on eBay and it seems to be > 700 USD so WAY more expensive than I would like.
Sure thing. I still need to play with the IPMI on it a bit. At least it doesn't appear to be locked down in any way.

As for pricing, I have access to them for less than that. :)
 
  • Like
Reactions: luckylinux

EasyRhino

Well-Known Member
Aug 6, 2019
686
574
93
Old Thread but I was wondering, given the high Power Consumption Figures ... Did anybody check to see if ASPM is enabled ?
TL:DR the board is probably going to be an idle hog no matter what.

I don't have mine anymore, I replaced mine with a cwwk fanless mini pc with 2.5gbe ports. (works great).

Previously, I ran it and I tried enabling "all" the power save features in bios. No i don't recall exactly how they were set because I don't have the board anymore. I never got it under 50W idle even when jumpering the x540 NICs off.


I was using opnsense (freebsd) so no linux kernel patching anyway.

My pet theory is it's the PLX switch that's sucking up the juice, or that even jumpering off the nics doesn't really cut off their power.

edit: ah our fellow eduncan here measured 13w even when powered off, just for the aspeed IPMI:
 
  • Like
Reactions: luckylinux

dqadri

New Member
Apr 16, 2023
1
0
1
I'm not sure if the BIOS I flashed has NVMe support for add on cards. I have tried using a SuperMicro AOC-SLG3-2M2 which plugs in two m.2 SSDs. I'm only seeing one SSD within the OS (Linux). I also tried using a Highpoint card that supports 4 m.2 SSDs, and has native boot and RAID support and I'm getting zero visible drives.

@BlueFox any ideas or other ROMs?
@EasyRhino any other modded BIOS images hanging around?
 

Zombielinux

Member
Jun 14, 2019
79
25
18
I'm not sure if the BIOS I flashed has NVMe support for add on cards. I have tried using a SuperMicro AOC-SLG3-2M2 which plugs in two m.2 SSDs. I'm only seeing one SSD within the OS (Linux). I also tried using a Highpoint card that supports 4 m.2 SSDs, and has native boot and RAID support and I'm getting zero visible drives.

@BlueFox any ideas or other ROMs?
@EasyRhino any other modded BIOS images hanging around?
Take a look at this and see if it helps. Garbage hardware and PCIe Bifurcation Part 3: Haswell
 

nexox

Well-Known Member
May 3, 2023
1,942
964
113
Remember the x16 (x8 electrical) slot on this board is connected through the PLX switch that the 10G NICs use, that means the bifurcation configuration will be different than almost any other board.
 

kapone

Well-Known Member
May 23, 2015
1,850
1,236
113
Once upon a time...I used to plug my WAN directly into the router/firewall...and then the LAN...and then the Wifi/AP...and then the OOB network...and then the "break glass" port...and...

Now...everything except break glass is terminated on my core switches. The router/firewall needs just one port (if you don't count the break glass port).

Edit: I should have specified...it does need a layer 3 managed switch.
 
  • Like
Reactions: nexox

luckylinux

Well-Known Member
Mar 18, 2012
1,521
475
83
And there's the Mellanox SX6036 with 36x 10/40/56gbe ports and with ALL of them populated (DACs)....still uses ~60w.
You are tempting me ... but it also depends on which NIC I can grab at reasonable Prices AND if QSFP28 Transceivers/DACs will support 40gbps Infiniband / 40 gbe Ethernet when connected to that Switch ... because if QSFP28 falls back to 10gbe then it's pointless.

Those are separate generations Speeds: (Q)SFP28 i.e. 100gbe/25gbe vs (Q)SFP+ i.e. 40gbe/10gbe, so not quite sure what "common Setting" if any exists between the two Worlds and if it's something "standardized".
 

josh

Active Member
Oct 21, 2013
635
212
43
Just saw this thread and am looking for a router with multiple 10GbE ports to replace my EdgeRouter-X. Is this board still relevant in 2025 as a pfsense box or is there something better/smaller these days? Don't really feel like running a 1U chassis for it
 

nexox

Well-Known Member
May 3, 2023
1,942
964
113
but it also depends on which NIC I can grab at reasonable Prices AND if QSFP28 Transceivers/DACs will support 40gbps Infiniband / 40 gbe Ethernet when connected to that Switch ... because if QSFP28 falls back to 10gbe then it's pointless.
Most 100G QSFP28 NICs (not sure about 50G QSFP28) will do 40G just fine (though I read about an Intel card that doesn't, dig around the forums for the details,) but QSFP cards are so much cheaper while 100G is dropping in price rapidly, it makes sense to just start with 40G and upgrade NICs when you get a 100G switch. QSFP28 DACs will do 40G just fine (56G is the weird rate that requires specific cables,) and most transceivers are pretty dumb and will happily transmit just about anything lower than their rated bandwidth, though I'm sure there are exceptions.
 

UhClem

just another Bozo on the bus
Jun 26, 2012
524
321
63
NH, USA
Remember the x16 (x8 electrical) slot on this board is connected through the PLX switch that the 10G NICs use, that means the bifurcation configuration will be different than almost any other board.
In that case, a modification of the eeprom for the PLX8747 might be in order.

See here: PCIE switch, oculink, nvme and sata
and here: PEX 8747 | 48-Lane, 5-Port PCI Express (8 GT/s) Switch
@Zombielinux , looks like you don't get the basics of PCIe switches. [For the PEX8747,] "5-Port" means [a max of] 4 target devices. I.e., re-configuring for 2x [x4 M.2] devices (targets) in the x8 slot means eliminating access to one (of 3) X540 chip.
 
  • Like
Reactions: nexox

Cruzader

Well-Known Member
Jan 1, 2021
940
932
93
Those are separate generations Speeds: (Q)SFP28 i.e. 100gbe/25gbe vs (Q)SFP+ i.e. 40gbe/10gbe, so not quite sure what "common Setting" if any exists between the two Worlds and if it's something "standardized".
They are backwards compatible, a QSFP28 4x25/100 can be used as QSFP 4x10/40.

Connectx3 does 56/50/10
Connectx4 EN does 100/56/50/40/25/10/1
Connectx5 EN does 100/50/40/25/10/1

For my last QSFP cables ive been buying QSFP28 to not have to replace them later.
 

luckylinux

Well-Known Member
Mar 18, 2012
1,521
475
83
They are backwards compatible, a QSFP28 4x25/100 can be used as QSFP 4x10/40.

Connectx3 does 56/50/10
Connectx4 EN does 100/56/50/40/25/10/1
Connectx5 EN does 100/50/40/25/10/1
Nice :) . Are those Figures with DAC only or also Transceivers ?

For my last QSFP cables ive been buying QSFP28 to not have to replace them later.
That was also my Plan :).
 

Zombielinux

Member
Jun 14, 2019
79
25
18
@Zombielinux , looks like you don't get the basics of PCIe switches. [For the PEX8747,] "5-Port" means [a max of] 4 target devices. I.e., re-configuring for 2x [x4 M.2] devices (targets) in the x8 slot means eliminating access to one (of 3) X540 chip.
I see. The documentation I was reading referenced the chip here: PCIe to SFF-8643, PCIe 3.0 x16 to eight-port SFF-8643 NVMe expansion card, which has 18 configurable ports.

I guess we'd be stuck adding an additional switch if we need more ports.
 

Zombielinux

Member
Jun 14, 2019
79
25
18
NO, you don't.

That was not documentation. That was amateurish speculation.
Real documentation is what you did link to in your post (which I quoted in my reply), that being the Broadcom technical product brief for the PEX8747.
And you clearly did not understand that documentation.
I think we're talking past each other a bit. The card I linked specifies the 8747 as its PCIe expander. I read & linked the wrong product brief from Broadcom. The 8747 has 18 ports, but isn't on this motherboard.

The 8749 IS on this motherboard and only has 5.

Regardless, a product brief is not documentation. But unless someone is willing to break an NDA, we probably won't see the real datasheets for either chip.