Added the cheap FCX model to the main post as an option to learn BGP/VRFs/etc in a lab with -
https://forums.servethehome.com/ind...s-cheap-powerful-10gbe-40gbe-switching.21107/
They predate the ICX line (came right before the ICX6610, in fact the ICX6610 and the FCX run the exact same bootloader and firmware images). They have no built in 10gbE, so you can get them cheap - around $30 for a BGP / VRF / tunnels / OSPF/ IPv6 / etc capable switch. The downside is no stock 10gbE as mentioned, they're a little louder, and draw a little more power, but not bad (around 40 watts, ICX6610 sound levels for the non PoE models, rocket ship sound levels for the PoE models). Overall I only recommend these if you're on a tight budget, don't really care about a lot of 10gbE, but want something capable of VRFs, BGP, OSPF, tunnels, etc to learn with
Advanced Routing License Note:
The FCXs required an EEPROM license to unlock the BGP and VRF capabilities. To do so, just run the following command from the bootloader (make sure to flash the latest bootloader from the guide first!):
Code:
i2c write a 0 feedface00000200ffffffffffffffff 1
reset
#will now boot and be permanently licensed for all advanced features
Notes on adding 10gbE to the FCX:
The FCX has no 10gbE by default. It comes with a card slot to add a 10gbE module. There's a 2 port 10gbE module, and a 4 port 10gbE module. There's two FCX switch types: one only takes the 2-port 10gbE card, and the other only takes the 4-port 10gbE card. To decide which you want/need:
First there's the "stacking" FCX models: These are the FCX624S and the FCX648S (the models with "S" at the end). These are by far the most popular and easiest to find for pennies. These have two special CX4 16gbps ports on the rear to stack with each other. These "stacking" models
only take the 2-port 10gbE XFP card. Search ebay for "ES4625M" to find these cards around $40. This is the easiest option if you want a good lab switch with 2x 10gbE ports for around $70 total.
Then there's the more rare "datacenter" models, the FCX624-I, FCX624-E, FCX648-I and FCX648-E (24 or 48 port, intake or exhaust airflow direction). These do not have the special CX4 stacking ports on the back, and
only take the 4-port SFP+ 10gbE card. The downside is, if you want to stack these models (they still support stacking), there's no dedicated CX4 ports in the back so you have to use one of the SFP+ ports for the stack connection. These models are harder to find, and typically more expensive. The SFP+ card for them is also more expensive. Search "FCX-4XG" on ebay to find the 4 port SFP+ cards for around $60. This means you can get an FCX datacenter model with 4 SFP+ ports for around $120 total, so it's not recommended over the quieter and more power efficient ICX6450 (unless you really need the BGP / VRFs / ETC and don't want to spring for the ICX6610 to get them)
Overall they're a little louder than the ICX6450 series, and predate the ICX line, but are incredibly powerful software wise and will do everything, so at $30 they can make great lab switches. For a permanent home network switch, or if you care about 10gbE, I would look at the newer models listed in the original post. I will say I've had a lot of these stuck in wiring closets and in use at LAN parties and they are rock solid models that will run forever, just missing out on a lot of 10gbE options
