1. Bjorn Smith

    Mellanox SX6018 L3 Routing

    Hi, I have this nice switch that I am really happy with, but I want to start using VLANS. I have created 3 VLANS and want to be able to route traffic between the VLANS. Reading up on it, it seem like you have to do the following: interface ethernet 1/1/2 no switchport force Which sets the...
  2. T

    mellanox mnpa19-xta 10g nic stop working

    one day my 10gig nic died for no reason, in lspci, that nic shows up as a memory controller[ib flash recovery], I tried to flash firmware but always get some error like "MFE_VERIFY_ERROR" "MFE_NO_FLASH_DETECTED"
  3. XeonSam

    Advice on vSAN networking : Infiniband

    I'm setting up a vSAN network with 3 Nodes. I have set up a vSAN cluster with 10G Ethernet (base-T) 2 years ago and wanted to delve into infiniband for a new test environment. I've done some reading up on this but wanted to get some tips from people who have successfully implemented a similar...
  4. I

    Help with understanding 40Gbe/56GbIB cabling

    Hi all, n00by here... but this place has a wonderful amount of knowledge. I asked a similar question in the Mellanox forums here: I have two MCX353A-FCBT cards on the way and I want to connect...
  5. J

    mini-itx 28c and dual 100GE

    Just finished my raptor extreme project. intel platinum 28c, mellanox connectx-5 dual 100GE nic in a custom sff mini-itx case: Imgur silent, powerful, and not ugly!!! jp next project: epyc rome 64c, supermicro proprietary mb, pcie 4.0, mellanox connectx-6 dual 100GE pcie 4.0 nic in an even...
  6. A

    FS: UniFi XG-16, Mellanox SX6036 & SN2700

    UniFi 16-XG "Beta" This is from the original "beta" sale. Includes 12x SFP+ modules $475 + shipping Mellanox SX6036: includes 56Gbe ethernet license & rackmount kit. $995 obo + shipping SN2700 Datasheet Quoted from Mellanox: SN2700 Spectrum-based 32-port 100GbE Open Ethernet Platform...
  7. BeTeP

    Another ConnectX-3 cross-flashing question

    I did not have much experience with high speed networks beyond 10Gbps Ethernet and I was under the impression that any ConnectX-3 with QSFP ports was at least 40GbE capable. But after I finally got myself a 40/56GbE switch (Mellanox SX6012) I quickly found that it was not the case. A few of my...
  8. M

    Port Flapping with Aristia Switch and Mellanox Connectx 3 Pro

    I have two Aristia 7150S-R that are mlagged together and I have all my servers using bonds across the mlagged switches. Four of my servers are experiencing random port flaps on then 10G. If I reboot the server it will stay up for 5-7 days and then start doing it again. Switch OS 4.18 Server OS...
  9. T

    Mellanox ConnectX-3 EN duplicate permanent MAC address issue

    I bought two second-hand ConnectX-3 (Model No CX311A, P/N MCX311A-XCAR) . These two cards work as expectation except these two cards have exact same permanent MAC address, please refer the attached photos and snapshot. The labels shown mac address should be "E4 1D 2D 6D XX XX", but the...
  10. Kei-0070

    Mellanox Connectx-3 not being detected

    Recently bought a Dell branded mellanox connectx-3 (CX322A PN: 19RNV) off ebay to put into my server but so far with my testing, I've not been able to get it to show up. Since my server is presently in bits awaiting a rebuild, I tried it in my old X79 based machine. I took it's intel X710 card...
  11. I

    Intel bids 6bn $ for Mellanox

    According to german it news site Golem and their source Intel bids 6billion $ for Mellanox. Sources: Intel Among Bidders for Chipmaker Mellanox - CTech Rechenzentren: Intel bietet wohl 6 Milliarden Dollar für Mellanox - (German) I'm wondering what will happen if Mellanox accepts the...
  12. A

    RDMA in ESXi 6.7 on ConnectX-2 Cards

    We have a series of 13 Dell R610 hosts with ConnectX-2 EN cards running ESXi 6.7. We have been trying to get RDMA (more importantly the iSER adapter) to enable and show up, however we have been unsuccessful. RDMA is supported by the FW, as we had gotten it to show up before with different...
  13. V

    Fighting New Mellanox ConnectX-3 Setup

    So, through much blood, sweat, and tears, I have my NAS and ESXi recognizing their new-ish ConnectX-3 cards in IB mode. I can send pings across the links and everyone looks happy. However, after adding my NFS storage to ESXi, I am now having another problem. Access to the NFS share from ESXi is...
  14. M

    Mellanox IS5030 License Issue

    Hello, We bought a used IS5030 switch from ebay. But only the top 18 ports can work and the rate is only 20Gb/s per port, even though we used QFP cables. It looks like a license problem. I found several numbers on the pull out tab. But it always shows Malform license key error when I tried to...
  15. T

    Need help with starting 10gb setup

    any help greatly appreciated... warning... n00b at this ... Ok so I'm new to this and I have a test lab at work. I have 4 esxi 6.7 boxes - will get to them later a windows 10 pc (dell precision 5810) Our guys were getting rid of a mess of hardware so I grabbed it and figured time to play...
  16. J

    RoCE use cases

    Hi Folks, Anyone come across or try out a killer use case for RDMA / RoCE? I know there are custom builds of some hadoop based apps but what have you found to be a great use of this tech? I have the box, now need the project. :) James
  17. mattaw

    Help with Connectx-3 back-to-back using FS QSFP-BD-40G

    Hey all, I used the instructions to cross flash two HP Connextx-3 cards QSFP to Mellanox MCX354A-FCBT's. I then installed two Fiberstore (FS) QSFP-BD-40G modules into one card configured as dual Ethernet. No dice, the link won't come up and the lights on the card stay off. Things I have...
  18. P

    Mellanox-Connectx2 Setup

    I recently got two MNPA19-XTR Mellanox-ConnectX2 cards and installed them into my servers. I followed another thread on here and they are both running fw=2.10.0720, the vstat is here: hca_idx=0 uplink={BUS=PCI_E Gen2, SPEED=5.0 Gbps, WIDTH=x8, CAPS=5.0*x8}...
  19. T

    FS - Mellanox IS5600 648-port 40Gb/s InfiniBand Chassis Switch

    I picked up a Mellanox IS5600 and do not have any personal use for it. Total Newb when talking about commercial-ish switches. This unit taken out of a working environment. Retailed for $500,000 retail LOL. Seriously. Half a milli! Listed for $3,000 USD plus shipping. Paypal or local cash...
  20. E

    DAC compatible with Cisco P81E VIC and Ubiquiti US-16-XG

    I ordered some SFP-H10GB-CU3M compatible (supposedly) DACs from, and although they're nice and thin, and work with my Mellanox Connectx-3 cards in my NAS', they are not compatible with my P81E 10GbE cards in my UCS servers. Can anyone recommend a good DAC in 3-5m distances to connect my...