Hi,
Mellanox have had "socket direct" adaptors since ConnectX-5 which avoid cross-socket bottlenecks by plugging into 2 PCIe slots:
Unfortunately they don't seem to be widely available/adopted?
There was a talk at the last OCP Virtual Summit about the same fuctionality from a single OCP 3.0 NIC:
It appears to require platform-specific features in order to connect to multiple PCIe buses? I'd be interested if this could be confirmed/tested in future reviews? This feature could be important for some use cases, for example some high-performance storage generally recommends a NIC per socket due to this issue.
I'd be really interested in a review of the Mellanox MCX653436A-HDAI ConnectX-6 VPI 200Gb/s OCP 3.0 card (current list price $1,795). That would be a fantastic amount of flexible bandwidth in a compact form factor (if it performs at specs?)
Generally I look forward to future OCP 3.0 NIC articles and reviews!
Thank you for your consideration, and for this site & community.
Mellanox have had "socket direct" adaptors since ConnectX-5 which avoid cross-socket bottlenecks by plugging into 2 PCIe slots:
NVIDIA Mellanox Socket Direct Adapters
Optimize performance in the most demanding applications. Mellanox Socket Direct eliminates traffic bottlenecks, enables direct PCIe access to multiple CPU sockets, and improves artificial intelligence and machine learning application performance.
www.nvidia.com
There was a talk at the last OCP Virtual Summit about the same fuctionality from a single OCP 3.0 NIC:
2020 OCP Virtual Summit: Managing a Socket Direct OCP NIC 3.0
View more about this event at 2020 OCP Virtual Summit
2020ocpvirtualsummit.sched.com
It appears to require platform-specific features in order to connect to multiple PCIe buses? I'd be interested if this could be confirmed/tested in future reviews? This feature could be important for some use cases, for example some high-performance storage generally recommends a NIC per socket due to this issue.
I'd be really interested in a review of the Mellanox MCX653436A-HDAI ConnectX-6 VPI 200Gb/s OCP 3.0 card (current list price $1,795). That would be a fantastic amount of flexible bandwidth in a compact form factor (if it performs at specs?)
Generally I look forward to future OCP 3.0 NIC articles and reviews!
Thank you for your consideration, and for this site & community.
Last edited: