And note that you need PCIe 3.0. http://www.mellanox.com/page/products_dyn?product_family=127ConnectX 3 EN cards are 10Gbe and support RDMA over Ethernet (RoCE).
Note, however that Windows only supports RDMA in their server OS. They do not permit RDMA on consumer versions (Win8/Win10). As long as you are running 2012R2 or 2016 on both ends it works great.
They actually work quite well on servers with only PCIe 2.0. PCIe is backward compatible and you don't need the extra bandwidth for the EN card to support 2x10Gbe. You need it to support 2x56GB FDR on the VPI cardAnd note that you need PCIe 3.0. http://www.mellanox.com/page/products_dyn?product_family=127
Thank YOU
What switch YOu been using them on?2 port ~$39-49 "NIB" / x2-VPI (PCIE2)
2 port ~$99-$199 "USED" / x3-VPI (PCIE3)
That's about what I've been paying for them on ebay recently. Working on deploying first IB stuff
Thank you for passing on the knowledge.They actually work quite well on servers with only PCIe 2.0. PCIe is backward compatible and you don't need the extra bandwidth for the EN card to support 2x10Gbe. You need it to support 2x56GB FDR on the VPI card
Actually, you can't quite get to 2x56Gbe even with PCIe 3.0 x8 - but you get close. Most applications are using the second port for redundancy/failover anyway so you never really expect 2x56G of throughput.
Yes these work with VMwareThank YOU
Will these Cards Work with VMware?
I never mention 40gbe. That was suggested. But 10gbe would be nice makes everything faster. I am not a patient man and now with ssds....@alex1002, what the hell are you doing in your lab that requires 40GbE?
If it was me, I would focus on what techno I want to learn / test and the minimum hardware that would allows me to do so.
Just an FYI, if you email Mellanox they will likely send you some brackets for free, assuming they still have them.Mellanox ConnectX-2 is super cheap. ~ $15 - $20 bucks. But it's a bit dated and doesn't have Remote Direct Memory Access (RDMA). Also, when buying these cards, be sure you get the correct profile for your available slots on your server chassis. Low profile or regular profile. Finding the low profile or regular profile brackets for them is nearly impossible.