Mellanox 40Gbe card (MCX314A-BCCT ConnectX-3 Pro) arrived. Result - zilch, zero, nada.
But, through deduction and further digging, I've probably came to certain conclusion about what seems to be the problem:
- It seems that these cards can provide 1.5 watt per port and, usually, 40GBase-LR modules need around 3.5 Watts.
- On the other hand, 40GBase-SR modules (multimode fiber) need around 1.5 Watt.
- Loopback on switch works because switch can deliver those 3.5 Watts per port.
Luckily, I waited for everything to be functional before I pulled the SMF cable from point A to Point B. Now, I need to deploy MMF cable, need to find 40GBase-SR modules and pray to Networking Gods that that setup will finally work in these cards.
I guess that's the price to pay for not digging every bit of info before buying. ;(