Hey,
new to Mellanox cards, RDMA in general. Wasn't sure what really to expect with these, but knew they'd be faster than current 82599-based network
I've got 3 hypervisors and was going to use these for storage backend, sharing between the 3 probably gluster, or maybe 2 with drbd (still haven't decided - probably not ceph, not enough machines).
Anyway, ESXi 7.0 reports these vibs loaded:
Questions:
new to Mellanox cards, RDMA in general. Wasn't sure what really to expect with these, but knew they'd be faster than current 82599-based network
I've got 3 hypervisors and was going to use these for storage backend, sharing between the 3 probably gluster, or maybe 2 with drbd (still haven't decided - probably not ceph, not enough machines).
Anyway, ESXi 7.0 reports these vibs loaded:
Code:
nmlx4-core 3.19.16.8-2vmw.701.0.0.16850804 VMW VMwareCertified 2021-02-05
nmlx4-en 3.19.16.8-2vmw.701.0.0.16850804 VMW VMwareCertified 2021-02-05
nmlx4-rdma 3.19.16.8-2vmw.701.0.0.16850804 VMW VMwareCertified 2021-02-05
ntg3 4.1.5.0-0vmw.701.0.0.16850804 VMW VMwareCertified
- ESXi says RoCE v1 possible but no RoCE v2 or nvme-of. Is RoCE v2 possible w/ connectx-3 cards, or am I hardware-limited to v1?
- I am using QSFP+ active fiber, and I flashed QCBT(10/40 en) cards to FCBT (40/46 en/ib), but if ESXi no longer supports IB does that mean I can't use the 56Gb IB unless I pass through the card to a VM? If I plan to use these through ESXi vNICs, should I have just left them as QCBTs (10/40Gb en)?
- Where do I find the FCBT 2.42 5000 firmware that comes in a TGZ file, so I can cross-flash? There's a link to 2.40 5030 in the forums, but I have no idea where to find the TGZ for latest version - I could only find the .bin file on the Mellanox website, and when I tried to sub 2.42 5000 for 2.40 5030 on link in forums, file not found and .htaccess index off on their server.