Hey, back down the rabbit hole of "how to use mellanox cards with 0 linux knowledge" d:^)
I currently have a pair of CX314A (Connect X-3)(40GbE Ethernet Only) connected over SR4 transceivers[Mellanox 40G QSFP+ MC2210411-SR4 Transceiver Module] and OM4 MMF (12 strand) [3m (10ft) 12-Fiber OM4 50/125 MPO Trunk Cable, Polarity B, LSZH] I've made no changes outside of increasing MTU to 9000 on both FreeNas and Windows. Yet transfer speeds seem hard capped at 14 Gb/s. This is especially noticeable when running multiple transfers from FreeNas to the same Windows machine on different drives. Neither the FreeNas array nor Windows drive destinations are causing the bottleneck. One thing I have noticed is the "Media Subtype" in Freenas showing CR4 rather than SR4. Is this a potential cause? Any suggestions on how to edit this property?
Thank you kindly in advance.
I currently have a pair of CX314A (Connect X-3)(40GbE Ethernet Only) connected over SR4 transceivers[Mellanox 40G QSFP+ MC2210411-SR4 Transceiver Module] and OM4 MMF (12 strand) [3m (10ft) 12-Fiber OM4 50/125 MPO Trunk Cable, Polarity B, LSZH] I've made no changes outside of increasing MTU to 9000 on both FreeNas and Windows. Yet transfer speeds seem hard capped at 14 Gb/s. This is especially noticeable when running multiple transfers from FreeNas to the same Windows machine on different drives. Neither the FreeNas array nor Windows drive destinations are causing the bottleneck. One thing I have noticed is the "Media Subtype" in Freenas showing CR4 rather than SR4. Is this a potential cause? Any suggestions on how to edit this property?
Thank you kindly in advance.