What's a good used 100G switch these days?

[aosudh]

Can you link the original post please?

Sure, It was so bad that I forgot this

https://twitter.com/i/web/status/1581219349037469698

 

[vangoose]

May I ask you if you have faced this issue? Let's say I want to link older X710-DA4 4xSFP+ card to this Arista, what's my best option?
Should I set it to 40G and may use:

Intel

Intel® Ethernet QSFP+ Breakout Cable

X4DACBL3

920347

606760003

QSFP+ to (4) SFP+ Direct Attach

Or it's not gonna work from switch side and I need:

Intel

Intel® Ethernet QSFP28 to SFP28 Twinaxial Breakout

XXV4DACBL2M

952303

NDAQGF-I202

100GbE/4x25GbE/4x10GbE Direct Attach

But set port as 4x25G operating in 4x10G mode, will it be accepted by NIC? As 100G breakout isn't listed in Intel® Product Compatibility Tool for X710-DA4, but for 2x25G XXV710-DA1/DA2

And what about single 40G XL710-QDA1 - will it work with regular QSFP twinax?

P.S. We're close to stick even with MikroTik due to it's baldness and three times lower price for a new one, as technically it's more than enough for our case, yet a bit afraid of newness and no positive feedback from Mtik course trainers

The 100Gb port supports 40Gb speed, you can plug in directly. It also has 2 10Gb ports, I use them to connect to ICX.

I got cables from FS, work really well.

 

[aosudh]

May I ask you if you have faced this issue? Let's say I want to link older X710-DA4 4xSFP+ card to this Arista, what's my best option?
Should I set it to 40G and may use:

Intel

Intel® Ethernet QSFP+ Breakout Cable

X4DACBL3

920347

606760003

QSFP+ to (4) SFP+ Direct Attach

Or it's not gonna work from switch side and I need:

Intel

Intel® Ethernet QSFP28 to SFP28 Twinaxial Breakout

XXV4DACBL2M

952303

NDAQGF-I202

100GbE/4x25GbE/4x10GbE Direct Attach

But set port as 4x25G operating in 4x10G mode, will it be accepted by NIC? As 100G breakout isn't listed in Intel® Product Compatibility Tool for X710-DA4, but for 2x25G XXV710-DA1/DA2

And what about single 40G XL710-QDA1 - will it work with regular QSFP twinax?

P.S. We're close to stick even with MikroTik due to it's baldness and three times lower price for a new one, as technically it's more than enough for our case, yet a bit afraid of newness and no positive feedback from Mtik course trainers

You might need to consider link aggregation, And theoretically, Your way of connection would work well.
But there still be some incompatibility problems as some eeprom in DAC/AOC that are used to negotiate link speed are fixed at a certain speed. For example, If the cable mention above is a 40G to 40G DAC,it just can't run 10G or 100G even if you're have set up in switches or NICs.
So if you're NICs are 10G, You'd better choose a 40G Breakout cable.

 

[Iaroslav]

You might need to consider link aggregation, And theoretically, Your way of connection would work well.
But there still be some incompatibility problems as some eeprom in DAC/AOC that are used to negotiate link speed are fixed at a certain speed. For example, If the cable mention above is a 40G to 40G DAC,it just can't run 10G or 100G even if you're have set up in switches or NICs.
So if you're NICs are 10G, You'd better choose a 40G Breakout cable.

Yes, these ports are for LAGs. But maybe that's the point when it's easier to get rid of 10G links at all and forget about all the possible incompatibility

 

[VMman]

Thanks for everyone's input, I ended up snatching two Mellanox SN2100 that @Rand__ shared on the deals thread.

I'll be sure to post an update once they arrive.

 

[lokkii]

To be honest, there is no way to use up those HIGHEND speed without rdma.

is there some tutorial for deploy ceph with rdma ? I have meet something wrong in deploying

 

[ano]

ceph with rdma does not work all that good from what I've researched

 

[Kartoff]

Thanks, but probably it's too exotic beast, XFP and too few of these

What XFP are you talking about ?
BTW I am considering of buying some of these Plexxi switches. Still not sure because never seen such and do not know what to expect...