infiniband

I am planning on building my own 4 port 40 Gb Infiniband, 2 Port 10 Gb SFP+, 1 Port 10 GbE Switch after watching an article on how to do so on the net, brilliantly cheap way of getting really high speed transfers between my soon to be Storage server and my two clients. I brought 8 MHQH19B-XTR's...

Hey folks, *I could be way off even my own topic here too as my personal experience with this model and even the fact it's not even delivered yet is a troubling issue to my factual experience on the matter, nice disclaimer eh.. (he says) The Voltaire 4036 switch even for its age is a very...

I have been running Mellanox QDR Infiniband primarily due to the magnitude of difference in latency using RDMA and its use via SRIOV in containers and VMs. Unfortunately Infiniband in the industry is almost entirely proprietary and PCIE fabrics have been a promising future for years now without...

Hi Folks Need help getting SR-IOV (inifiniband) to work with Proxmox-ve. I’ve installed MLX_OFED_LINUX ver 4.3-1.0.1.0 installed on both the host (proxmox ve 5.4-3 and the guest (ubuntu 18.04). I’ve enabled SR-IOV in the firmware of the card, SR-IOV on MLX_OFED Driver and go the point of...

According to german it news site Golem and their source Intel bids 6billion $ for Mellanox. Sources: Intel Among Bidders for Chipmaker Mellanox - CTech Rechenzentren: Intel bietet wohl 6 Milliarden Dollar für Mellanox - Golem.de (German) I'm wondering what will happen if Mellanox accepts the...

So, through much blood, sweat, and tears, I have my NAS and ESXi recognizing their new-ish ConnectX-3 cards in IB mode. I can send pings across the links and everyone looks happy. However, after adding my NFS storage to ESXi, I am now having another problem. Access to the NFS share from ESXi is...

Hello, We bought a used IS5030 switch from ebay. But only the top 18 ports can work and the rate is only 20Gb/s per port, even though we used QFP cables. It looks like a license problem. I found several numbers on the pull out tab. But it always shows Malform license key error when I tried to...

I picked up a Mellanox IS5600 and do not have any personal use for it. Total Newb when talking about commercial-ish switches. This unit taken out of a working environment. Retailed for $500,000 retail LOL. Seriously. Half a milli! Listed for $3,000 USD plus shipping. Paypal or local cash...

Hi there all, I've just finished setting up a nice AIO proxmox server and between it and my workstation (direct connection), it saturates 10Gb or gives a faster then local SSD speed depending on work load (NFS maxes out at 4GB/s but thats a different thread)......and now I want more. Well not...

Hello all, I was thinking, for my living room where I have quite a few servers running (silent !), to do a custom 10gbe IPoIB setup. In my lab room I could use the Voltaire 4036 (non-E version unfortunately) which I still need to find a way to silence. It's way too noisy even for the server...

Hello! I have the opportunity to purchase some used dual-port Mellanox MCX354A-QCBT ConnectX-3 cards with VPI network adapter. (10 GbE Ethernet and 40 Gbps InfiniBand.) These would be perfect for my cluster after correct configuration.. They were originally pulled from EMC systems and...

Hi, I have a weird problem. I purchased 4x used identical Sun QDR X4242A Infiniband cards (Mellanox MHQH29B rebrands) for my 4 node supermicro 6027TR-HTR (X9DRT-HF) server. 3/4 cause boot to hang at post code 91, which is when the PCI stuff is loaded. The fourth one seems to let the node boot...

Good Afternoon everyone. You will have to excuse my ignorance when it comes to infiniband/ SFP/ SFP+ and QSFP. I have purchased two Mellanox MHQH29C-XSR ConnectX-2 VPI 10/40 Gbit Low Profile Dual-Port Adapter Cards for use in my home network (purely for learning purposes and for transferring...

Unbelievable deal! These are low profile dual port cards capable of 56Gbps IB and 40Gbps Ethernet. I messaged the seller and bought 32 cards for $25 each plus shipping. He said he has 1300 in stock so there's plenty for everyone :) They can be flashed from their HP firmware to stock Mellanox...

Build’s Name: RCluster (30 nodes) Operating System/ Storage Platform: Proxmox VE 5.1 CPU: AMD Ryzen 7401P Motherboard: Supermicro H11SSL-C Chassis: RMC3116-670-HSE with SAS3 expander Drives: (16) Seagate ST6000NM0034 SAS3 6TB RAM: DDR4 2666mhz ECC Reg 64GB x4 and 64GB x8 Network Cards...

Hi, I'm having speed issues that I've isolated to my IS5030 switch. System: I have two Infiniband switches: 1. A Mellanox IS50XX with 36 ports enabled and the FrabricIT internal subnet manager running, making it an IS5030, with latest firmware (IBM P/N: 98Y3756) 2. A Sun 36 port QDR Infiniband...

HP 649281-B21 Infiniband FDR/EN 10/40GB 2P 544QSFP ADAPTER 656089-001 661685-001 Product of Israel and FDR. Are these HP-rebranded Mellanox ConnectX-3? I recently got some CX2 QDR cards because they were a lot cheaper than the CX3s and I figured QDR will be plenty fast for home use. I also...

Hi, Newbie to Infiniband. Had several MHGH28-XTC and CX4 cables from a deal , would like to try out Infiniband/VSAN in my home lab. Anyone familiar with those switches? Xsigo IS24 F-X430083 Expansion Switch QLogic SilverStorm 9024-CU24-ST2-DDR Which one will be better? Or they just work the...

I'm planning a 40gbe (maybe infiniband) network for my homelab. I don't have a dedicated server room and from what I read the 40gbe switches are very loud (Mellanox list some of it's ethernet switches with 70dba). In different threads on sth people posted about soundproofed enclosures like the...

Frist post here so I thought I would start by helping others. Ok, so you know the cheap optical QSFP transceivers on eBay, Well it turns out you can use them. First you need a MPO cable to use, and as a warning, they are not the cheapest things so be very careful when following this guide...