40gbe

  1. R

    40GbE ConnectX-4 to ConnectX-3 Transceiver Recommendation

    tl;dr - I'm trying to connect a ConnectX-4 MCX4131A-BCAT to a ConnectX-3 MCX354A at 40GbE. My Kaiam XQX2502's only seem to negotiate 1GbE. Is there a transceiver that will get me back to 40Gbps? Previously, I had two ConnectX-3 MCX354A's connected (Windows to Linux) with Kaiam XQX2502's linked...
  2. Luzer

    Borked Flash of a Mellanox CX354A ConnectX-3 - Missing Second Port

    While trying to cross flash my CX354A I think I disabled the second port on the card by flashing the single port firmware. When I run '/opt/mellanox/bin/mlxfwmanager' on my esxi server I only get 'Device #1' and before the flash, on the original FW, I got Device #1 and #2'. Any suggestions on...
  3. C

    How to use the mlx5_core driver with Mellanox ConnectX-4 Lx in Debian?

    I just got these ConnectX-4 Lx in the mail, but not getting very far. I've been treating this like the ixgbe driver: I see Kernel driver in use: mlx5_core and am trying to create virtual functions in /etc/modprobe.d/mlx5_core.conf with some options like options mlx5_core num_vfs=12...
  4. AveryFreeman

    "cheap" 40GbE switches - Celestica XP D4040 or Juniper QFX3600 (?)

    Hey, I've never worked with any QSFP+ switches before, but it seems like some fairly decent ones are starting to get pretty affordable on eBay. There's the Mellanox stuff that can be had super cheap, but a lot of the pitfalls I've seen described on this forum make me apprehensive. I came...
  5. I

    10Gb/40Gb upgrade considerations - advice wanted

    Hi folks, I'm about to have my incoming WAN connection from my ISP upgraded to a 3Gb plan. The connection will be provided via SFP+ module into a router/switch of my choice My current plan is a 1Gb plan, coming in via SFP into a Ruckus ICX 7150 -> ESXi host -> pfSense The ESXi host specs are...
  6. Alfa147x

    [FS] - [USA-CA] - [SOLD] - Pair of ConnectX-3 Infiniband + 40GbE QSFP Adapter Cards with Cable - $90 Shipped

    *** SOLD *** I have the following for sale as a bundle: 2x Molex 106410-1002 Fiber Optic Cable Assemblies QSFP AOC 40G 1.2, 2m 2x HP/Mellanox 649281-B21 ConnectX-3 VPI FDR IB Infiniband + 40GbE QSFP Adapter Cards. These cards are equivalent to Mellanox part number MCX354A-FCBT and have had...
  7. K

    Cheap 40gbe Network Cards - Ebay USA

    Does anyone see any "gotchas" with the card below? Looks to be TCP/IP network interface cards, I was thinking these may be a good upgrade from my current 10gb direct connect networking. What do you all think...
  8. B

    Synology Low Speed with 40Gbps NIC & Nvme SSD

    Hello guys, sorry for my poor English. I just built a server with Xpenology(synology) on C612 motherboard, 40G nic, 2 x samsung PM1725a 6.4T nvme pcie ssd(2 x basic no raid) just in case some ppl don't know it yet: We now are able to use nvme ssd as storage in synology (by using mdadm in ssh)...
  9. I

    Help with understanding 40Gbe/56GbIB cabling

    Hi all, n00by here... but this place has a wonderful amount of knowledge. I asked a similar question in the Mellanox forums here: https://community.mellanox.com/s/question/0D51T00007CGDzUSAX/which-cables-for-a-pair-of-mcx353afcbt I have two MCX353A-FCBT cards on the way and I want to connect...
  10. BeTeP

    Cheap 40GbE at home - too good to be true?

    This is not a humble brag post - I am genuinely curious if I am missing something. It's been a few weeks since I upgraded my home network to 40Gbps. So far it has been running smoothly and the upgrade process was pretty painless and significantly less expensive comparing to the 1Gbps to 10Gbps...
  11. BeTeP

    Another ConnectX-3 cross-flashing question

    I did not have much experience with high speed networks beyond 10Gbps Ethernet and I was under the impression that any ConnectX-3 with QSFP ports was at least 40GbE capable. But after I finally got myself a 40/56GbE switch (Mellanox SX6012) I quickly found that it was not the case. A few of my...
  12. D

    40GbE - will that hardware combination work?

    Hello, I am upgrading my homeserver to a 3-node CEPH+Proxmox HA-VM Cluster. As 1GbE will probably be too slow for CEPH I am considering upgrading. 10GbE and 40GbE is not that big a price difference so I am thinking of going directly to 40GbE. I am situated in Europe. As my netorking...
  13. J

    Speedy NAS, help needed: Want 1.0GB/s

    Thank you for taking the time to read- I have a number of nodes that (I'm being told) now need to write to a NAS (that was designed for redundancy and capacity) at much faster speeds than operational. Currently a Windows box over a 40gbe Mellanox fibre card writes to the TrueNAS box (40gbe...
  14. M

    [EU] Looking for cheap SFP+ switches and QSFP+ backbone switch

    I have a few ConnectX-3 cards with dual QSFP+ ports on each and I'd like to have their capacity available for a local LAN party (36 total 1G ports required) without breaking the bank. The problem is the QSFP+ enabled switches common in the US are either much more expensive in the EU or just...
  15. mattaw

    Help with Connectx-3 back-to-back using FS QSFP-BD-40G

    Hey all, I used the instructions to cross flash two HP Connextx-3 cards QSFP to Mellanox MCX354A-FCBT's. I then installed two Fiberstore (FS) QSFP-BD-40G modules into one card configured as dual Ethernet. No dice, the link won't come up and the lights on the card stay off. Things I have...
  16. S

    Which 40GbE/10GbE NICs and cable for PC to PC file transfers?

    I want to connect my desktop, another workstation and NAS for faster file transfers for rather cheap (mainly video/photo content - 300-500GB transfers suck on 1GbE right now). I don't want to spend the $ on a switch yet because I'm on a rather tight budget, so it would be all directly connected...
  17. A

    Has anyone else bought Fiber store Cat8 ethernet cable

    Has anyone else bought Fiberstore Cat8 ethernet patch cable? I bought some recently as I was looking for some quality shielded cables in the 7-10ft range and their cat 8 cables were cheep. $3.50-$4.50. After checking these out today I noticed that these cables are 26 awg thick. Having felt some...
  18. J

    Cheap 40gbe switch NOT ebay

    For a variety of reasons I can't go the same route I went at home. I've seen FS.com referenced here a couple of times, and I found one of their switches there that's within budget (3k). N5850-48S6Q . Has 6x 40gbe ports and 48 10gbe sfp+ ports. I need 5 40gbe ports and a smattering of sfp+...
  19. MikeWebb

    Faster then 10Gb home, home office and lab recommendations (IB, VPI etc?)

    Hi there all, I've just finished setting up a nice AIO proxmox server and between it and my workstation (direct connection), it saturates 10Gb or gives a faster then local SSD speed depending on work load (NFS maxes out at 4GB/s but thats a different thread)......and now I want more. Well not...
  20. L

    HP 649281-B21 ConnectX-3 VPI MCX354A-FCBT $35 + $8 shipping OBO ebay

    Unbelievable deal! These are low profile dual port cards capable of 56Gbps IB and 40Gbps Ethernet. I messaged the seller and bought 32 cards for $25 each plus shipping. He said he has 1300 in stock so there's plenty for everyone :) They can be flashed from their HP firmware to stock Mellanox...