Dual 100gbe PCIe 4.0 x16 MCX516A-CDAT <=$450

Rand__

Well-Known Member
Mar 6, 2014
5,160
1,070
113
It should run fine.
Note these are ETH only cards, not VPI (which is less an issue nowadays for most of us here I assume;))
 

Laugh|nGMan

Member
Nov 27, 2012
33
7
8
I got one. Kind of pricey for EU. With delivery and taxes approx. 542 EUR
_DSC4646.jpg _DSC4648.jpg _DSC4660-Enhanced.jpg _DSC4671.jpg _DSC4672.jpg _DSC4685.jpg _DSC4687.jpg _DSC4689.jpg CX5_0.jpg CX5_2.jpg CX5_3.jpg CX5_4.jpg CX5_1idle_temp_x9srl-f_second_top_slot.jpg
Temp idle with mget_temp.bat - 70
Temp under one port load with mget_temp.bat - 75
With infrared thermometer under load edge of heatsink 45 CELSIUS
Inside supermicro case 742i 3 fans screaming (2xFAN-0052, 1xFAN0051L4).

Run few benches with iperf3 with x9srl-f+E6-1650v2 Power options (High performance)
between two 100GBE cards and HP branded MFA1A00-E020 20m fibre.
Dell HWTYK in PCI-E 8.0 GT/s x8 (in x8) slot
Mellanox MCX516A-CDAT in PCI-E 8.0 GT/s x8 (in x16) slot
_DSC2328.jpg screenshot.jpg

Bench SUM was +/- 40-44 Gbits/sec. PCI-E 3.0 x8 limit should be 62 Gbits, so dont't know whats going on. Spectre + meltdown perf hit maybe.... or flawed benchmarks, or IvyBridge 4ch memory bandwidth limit...
4ch_IvyBridge1650v2_stream_MT_8t.JPG

./iperf3 --server --interval 10 --port "9001"
./iperf3 --server --interval 10 --port "9002"
./iperf3 --server --interval 10 --port "9003"
./iperf3 --server --interval 10 --port "9004"
./iperf3 --server --interval 10 --port "9005"
./iperf3 --server --interval 10 --port "9006"
./iperf3 --server --interval 10 --port "9007"
./iperf3 --server --interval 10 --port "9008"

./iperf3 --title "test9001" --time 60 --interval 10 --port "9001" --client 192.168.0.4 --parallel 4
./iperf3 --title "test9002" --time 60 --interval 10 --port "9002" --client 192.168.0.4 --parallel 4
./iperf3 --title "test9003" --time 60 --interval 10 --port "9003" --client 192.168.0.4 --parallel 4
./iperf3 --title "test9004" --time 60 --interval 10 --port "9004" --client 192.168.0.4 --parallel 4
./iperf3 --title "test9005" --time 60 --interval 10 --port "9005" --client 192.168.0.4 --parallel 4
./iperf3 --title "test9006" --time 60 --interval 10 --port "9006" --client 192.168.0.4 --parallel 4
./iperf3 --title "test9007" --time 60 --interval 10 --port "9007" --client 192.168.0.4 --parallel 4
./iperf3 --title "test9008" --time 60 --interval 10 --port "9008" --client 192.168.0.4 --parallel 4
 

Attachments

Last edited:

Rand__

Well-Known Member
Mar 6, 2014
5,160
1,070
113
Yeah, considered them too, but at this time I am not only pushing the pcie3 version.. so need for the -4 ... and prices will come down;)

Were these idle temps or under load?
 

Rand__

Well-Known Member
Mar 6, 2014
5,160
1,070
113
you checked what those are rated for?

Never bothered to look since never had any issues at all (despite subpar cooling, but usually in open case while testing)