ConnectX-3 Pro -- 40g QSFP compatibility?

[funkywizard]

Hey everyone. Been lurking a while, first post.

Anyway, got a bunch of gear from ebay and fs to upgrade our network. One bit we tested had issues, any insight appreciated.

Have some ConnectX-3 Pro (HP relabeled) 40g VPI nics.

-- Works @ 10g with QSA adapter and either a DAC or SFP+ optic.
-- Works @ 40g with a QSFP+ -> QSFP+ DAC
-- Does not work with an arista-coded QSFP+ SR4 optic from fs.

Tested when connecting to another SR4 on an arista switch w/ MTP-12 MMF patch cable.
Arista switch -> Arista switch works with these optics and cable.

Before I try everything under the sun:

-- Any special driver configuration to enable third party optics? Or optics in general?
-- Are these more likely to work using a different brand of SR4 optic?
-- Anyone else had good / bad luck @ 40g with optical on these cards?

Thanks in advance. Hopefully the first post of many.

 

[Patrick]

I think all the optics I am using are Mellanox as are the DACs.

 

[funkywizard]

I think all the optics I am using are Mellanox as are the DACs.

Thanks for the quick reply. I can definitely pick up a mellanox SR4 from ebay and try it if that's more likely to work. About the same cost as the optics I already have.

Anyone else tried these with third party SR4's?

 

[i386]

Maybe it's the hp firmware. Mellanox tries to support as many as possible transceivers, dacs and aocs.

You could try to flash your cards with a custom firmware and try it again with the Arista optics.

Flash OEM (IBM) Mellanox ConnectX-3 EN with stock firmware?

Custom Firmware for Mellanox OEM Infiniband Cards - WS2012 RDMA

 

[pc_doom]

Thanks for the quick reply. I can definitely pick up a mellanox SR4 from ebay and try it if that's more likely to work. About the same cost as the optics I already have.

Anyone else tried these with third party SR4's?

I've ordered some Mellanox compatible SR4 from fs for the NICs, so problems.