infiniband

Hi guys, looking for opinions and for an input regarding updating and possibly cross-flashing firmware on ConnectX-5. I was in need of an OCP3 NIC and was able to obtain a single-port ConnectX-5 relatively inexpensively. It turned out to be some sort of engineering sample. It introduces itself...

Seen a few of these Mellanox ConnectX-3 MCX354A-QCBT 40Gbps InfiniBand Dual Port QSFP High Profile going dirt cheap on ebay UK and was wondering what switch and cabling is recommended to connect 3 servers together and a switch that has a dual RJ45 10G port and provides 1G connections, price is...

Hi there! I've been working on deploying 40G networking in our house for a dedicated storage network, and because all of our PCs are Windows based, I opted to go for a Windows Server VM that supplies shares over SMB Direct (RDMA), through Infiniband Connect X-3s. Here's the layout of how I have...

Hi, As a complete noob for Infiniband i want to build a cluster from 4x Dell C6420 nodes each having one 56Gbps (Dual Port) QSFP HCA - Mellanox MCX354A-FCBT and i would like to connect them with one Nvidia Mellanox SX6025 switch. Now i am looking for cables. I have found the HP 670759-B23...

Now that I’ve built a pair of fully-solid state ISCSI targets using TrueNAS core I’d like to upgrade my network to provide the lowest latency from these boxes to my 3-node ESX 7.03 cluster and I’m looking for recommendations. PCI slots are at a premium on my boxes so I’m thinking a dual-port...

have a Mellanox SX6036 switch that's currently set up in InfiniBand mode. I'm interested in switching it to Ethernet mode for our network needs. Has anyone gone through this process before? I am going all over the Internet, and I cannot find it. Thanks!!!

Edit: Everything below is... well, it's not wrong, except RDMA is actually not working for ANY hosts. Everything is going through IPoIB and it's awful. I thought it was working for other hosts but it is not. Original post: This host ("shark") currently has four RDMA-aware functions, and none...

Hello everyone, Recently I purchased a pair of ConnectX-3 354A FCBT Oracle branded dual port NICs. The original firmware indicated it was an fcbt model. I then proceeded to cross flash it to original mellanox firmware. I received a QSFP+ cable yesterday, ordered from ebay: - HP Mellanox...

Good morning, We've had an SSD on our sb7800 infiniband switch fail, have installed a new drive with a cloned image from one of our other identical switches. So far everything looks ok in the management interface, aside the Host ID. Though we do get 1003, 1006 errors when trying to modify...

Hi, I work for a research hospital. I would appreciate any comments or advice for file system and hardware design for a high-end storage solution. We have a few microscopes (running windows 10), each can produce 3-4GB/s of image data that needs to written to the shared storage and to be...

I looking for a better understanding on the difference between IPOIB and ETH mode on ConnectX-3 adapters (40/40 IB/Eth) Couldn't find answers to my questions online; if someone could point me towards the right direction, it would be much appreciated. 1. My understanding is the IPOIB runs on top...

Hi everyone, I am currently in the process of planning an Infiniband Network for our new GPU cluster. We want to be able to run simulation / AI workloads across the big GPU nodes and are hence looking to connect everything with a 100 Gb Infiniband-Network. At first, I was thinking of the...

Hi all, I have a couple z840 workstations that I'd like to connect with Mellanox ConnectX-3 VPI 40Gb network cards. These are PCIe gen3 cards that the mobo on the z840 supports (I have tested the PCI slots with two graphics cards and the machines boot fine). When I install the network card...

I'm using a pair of dual port Connectx-3 cards (Part# MCX354A-FCBT on FW 2.42.5000 ) and I seem to be stuck at 10Gb. My ultimate goal is to get to pure Infiniband connectivity between the servers and the storage. I have Dell PowerConnect 8132(N4032) switches AND a pair of Mellanox IS5022...

Hey, I've never used an IB adapter before, but I was thinking of doing some direct-attached IB adapters for my 3 ESXi hosts now that I learned my 3 Intel 82598EB adapters I dug out of storage are now no longer supported. I do have VCSA if that matters. I have 82599 10GbE for basic networking...

No, not my offer. Since I am on EDR at home by now, I don't need it... Mellanox IS5022 InfiniBand Switch 8 ports managed | eBay

New project. I received an SX6012 for shipping costs only. Tried to get it running and to get a console today. First of all, the switch starts. Both fans in the middle are running 100%. Both fans in front of the power supplies are running on minimum rpm. Mgmt port shows straight green and...

Hello again! Probably should have consolidated the FS and WTB ads in one post but for clarity I figured I'd post twice. If you're here from my FS post, I am looking for the above equipment. Does anyone have one for sale? Please let me know. Happy new year!

Hello boys and girls, I have here for sale the above item. I want to move up to an FDR switch as part of upgrading my home lab, so if anyone wants to get started, play around and learn about Infiniband networking with a cheap switch (DAC cables go for pretty cheap on eBay as well), this might...

It's Christmas ... Looking for cheap un-/managed 6012/6015's here in EU only. If you can include cables you were working with, SUPER !!! Ok, if you pay the shipping 'Overseas' are welcome as well ;) If you have a 6036 for cheap, I will consider your offer as well.