Hi all,
I just wanna share my (interesting) results with the cx3 boards.
So, first of all, I've got a pair of cx3 mcx354A-qcbt - 40g ib and 10g ethernet.
Well, tweaking the ini, I got the cards to work at 56gbps ib or ethernet (mind you, 56gbps is a mellanox proprietary mode and it requires cables, hcas and eventual switches that work at that speed)
Just get the mcx354a-fcb appropriate ini (Ax version) and go for it. (yeah, burn with --allow_psid_change)
On a side note, the cx3's chip will run at 427MHz as opposed the 258 for the QDR version. So far (2 month 24/7) the chips don't seem to get hotter than the stock version or more than the old cx2's that I have.
On another side note, USE the mlnx ofed package - the performance difference from the standard ofed stack is huge. You can get the same traffic/latency levels but with a much lower CPU usage.
With normal cheap amphenol 40gbps qdr cables, 40gb is the maximum speed, either ib or ether.
I've tried (so far without luck) to get a breakout cable to work at 4x10gb on the cx3's qsfp+ port.
The most traffic I was able to test with were 50Gb/s ish on both ports. I only have one machine with pcie 3.0 ports to test with . Others are only 2.0
Cheers,
I just wanna share my (interesting) results with the cx3 boards.
So, first of all, I've got a pair of cx3 mcx354A-qcbt - 40g ib and 10g ethernet.
Well, tweaking the ini, I got the cards to work at 56gbps ib or ethernet (mind you, 56gbps is a mellanox proprietary mode and it requires cables, hcas and eventual switches that work at that speed)
Just get the mcx354a-fcb appropriate ini (Ax version) and go for it. (yeah, burn with --allow_psid_change)
On a side note, the cx3's chip will run at 427MHz as opposed the 258 for the QDR version. So far (2 month 24/7) the chips don't seem to get hotter than the stock version or more than the old cx2's that I have.
On another side note, USE the mlnx ofed package - the performance difference from the standard ofed stack is huge. You can get the same traffic/latency levels but with a much lower CPU usage.
With normal cheap amphenol 40gbps qdr cables, 40gb is the maximum speed, either ib or ether.
I've tried (so far without luck) to get a breakout cable to work at 4x10gb on the cx3's qsfp+ port.
The most traffic I was able to test with were 50Gb/s ish on both ports. I only have one machine with pcie 3.0 ports to test with . Others are only 2.0
Cheers,