Mellanox MCX311A-XCAT 10 Gigabit Ethernet PCIe Adapter Card ConnectX-3 CX311A $12 obo + $15 Shipping

Discussion in 'Great Deals' started by zeynel, Nov 27, 2017.

  1. Serhan

    Serhan Member

    Joined:
    Sep 22, 2017
    Messages:
    45
    Likes Received:
    8
  2. BLinux

    BLinux cat lover server enthusiast

    Joined:
    Jul 7, 2016
    Messages:
    2,354
    Likes Received:
    816
    #62
  3. _alex

    _alex Active Member

    Joined:
    Jan 28, 2016
    Messages:
    874
    Likes Received:
    94
    I think for stable/reliable Performance the whole network should be lossless.
    This means also the Switch should be configured for 'Global Pause' or 'PFC' on the Ports used for RoCE - what can be quite painful and a limit on usable Switches.

    Never setup RoCE because of this but would be interested in some reports if it's worth the efforts involved.
     
    #63
  4. Spartus

    Spartus Member

    Joined:
    Mar 28, 2012
    Messages:
    139
    Likes Received:
    19
    I got a few requests for printed brackets. Will do, but haven't designed them yet, because I haven't received the cards yet. If you are in a rush I would suggest ordering from Mellanox. I'll report back once I have designed and printed mine.

    Cheers, all.
     
    #64
  5. iLya

    iLya Member

    Joined:
    Jun 22, 2016
    Messages:
    48
    Likes Received:
    5
    I am starting to play with the cards as well and so far I am finding that the firmware is slightly outdated.
    If you are interested in updating the firmware, you can download the MFT package from Mellanox using this link:

    Mellanox Firmware Tools
    MFT User Manual

    In the manual they have a section that talks about being able to check the firmware directly against their website and perform the update.
    However what I've discovered is that the firmware that appears to be available from Mellanox website directly is actually newer than what the tool is able to detect.
    Here is the link to the latest firmware that I was able to find for these cards:
    FW-ConnectX3-rel-2_42_5000-MCX311A-XCA_Ax-FlexBoot-3.4.752.bin.zip

    I also think its possible to enable RDMA with these cards using the Quanta LB6M 10GB switch because it supports DCB and PFC which should enable the lossless network. Now I just need to learn how to setup VLANs, enable Trunk Ports and I should be a happy camper :)
     
    #65
  6. iLya

    iLya Member

    Joined:
    Jun 22, 2016
    Messages:
    48
    Likes Received:
    5

    @0xbit,

    Here is a link to the simple comparison that I found on the Mellanox website:

    Adapter comparison

    The biggest things that I see are related to RoCE v2 support (Routing) and hardware offloading for Overlay Networks (VXLAN/NVGRE) which are important for SDN (Software Defined Networking).
    So it all depends on how crazy you want to go with your setup. If you are playing with things like AzureStack, then this is probably important and in fact you probably want to go to ConnectX-4 or 5 cards. However if you are doing a smaller home setup, then these cards should be plenty.

    For me, I am going to figure out how to get RDMA working and in order to get around the RoCE v1 limitation of routing, I am going to change my network config to probably leverage the /16 address space because I am planning to build out a SDN based lab using SCVMM with Network Controllers, etc....

    Once I get this sorted, I really want to get the ConnectX-5 cards because of the eSwitch capability and the fact that you can link up to 4 servers together without a switch by looping the dual ports together. Here is a LINK
     
    #66
  7. i386

    i386 Well-Known Member

    Joined:
    Mar 18, 2016
    Messages:
    1,680
    Likes Received:
    410
    If these cards are vanilla mellanox cards just install the (win)ofed package from mellanox and it will update to the latest firmware.
     
    #67
  8. iLya

    iLya Member

    Joined:
    Jun 22, 2016
    Messages:
    48
    Likes Received:
    5
    I did install the WinOF package but the firmware was still older than what was available.
    I ended up having to download the firmware directly from their site and using flint tool to flash it to the latest version.
     
    #68
  9. i386

    i386 Well-Known Member

    Joined:
    Mar 18, 2016
    Messages:
    1,680
    Likes Received:
    410
    Weird, I updated my two cx-2 and almost all my cx-3 cards this way.
     
    #69
  10. Antonio

    Antonio Member

    Joined:
    Dec 20, 2015
    Messages:
    31
    Likes Received:
    5
    Spartus, If you are still printing the brackets, could you make 4 for me?
     
    #70
  11. abq

    abq Active Member

    Joined:
    May 23, 2015
    Messages:
    407
    Likes Received:
    62
    Hi Spartus, i would be glad to pay for 4 brackets too, if you have time. Thx Much :)
     
    #71
  12. kiteboarder

    kiteboarder Member

    Joined:
    May 10, 2016
    Messages:
    84
    Likes Received:
    29
    Also willing to pay for 4 brackets if you get around to making them. TIA!
     
    #72
  13. Antonio

    Antonio Member

    Joined:
    Dec 20, 2015
    Messages:
    31
    Likes Received:
    5
  14. Spartus

    Spartus Member

    Joined:
    Mar 28, 2012
    Messages:
    139
    Likes Received:
    19
    #74
  15. BLinux

    BLinux cat lover server enthusiast

    Joined:
    Jul 7, 2016
    Messages:
    2,354
    Likes Received:
    816
    hey, how many of you guys need these brackets and how many? shipping from Mellanox might be expensive for small orders, but if I order in bulk, the high shipping costs is reduced per bracket and then I can probably re-send them back out 1st class post for cheap, likely $3 or so within USA. So, for small quantities, this might make sense to do.... i'm happy to donate my time as long as my costs are covered. the postman picks up packages from my place every day anyway and I've got some used envelopes I can reuse. let me know if that's something you guys want to consider and we can then figure out if there's enough people and the details.
     
    #75
  16. homelabusr

    homelabusr Member

    Joined:
    Feb 7, 2017
    Messages:
    49
    Likes Received:
    4
    Just FYI,
    Mellanox told me that the perforated ones would take 4-6 weeks to ship.
    They we're okay with shipping a replacement bracket MTM005078 which was " not perforated, but should fit the MCX312B", those being 16 in stock.

    I preferred to wait.

     
    #76
  17. antsh

    antsh New Member

    Joined:
    Sep 14, 2017
    Messages:
    17
    Likes Received:
    0
    I'm in for one.
     
    #77
  18. Serhan

    Serhan Member

    Joined:
    Sep 22, 2017
    Messages:
    45
    Likes Received:
    8
    I am in for one also


    Sent from my Moto G (4) using Tapatalk
     
    #78
  19. DavidRa

    DavidRa Infrastructure Architect

    Joined:
    Aug 3, 2015
    Messages:
    253
    Likes Received:
    111
    Thanks for the offer - I'm seeing USD80 for the parts and USD70 for shipping 6 of them to Australia. Crazy.

    What do you reckon it would end up being if I brokered through you? Obviously the parts are the same.
     
    #79
  20. BLinux

    BLinux cat lover server enthusiast

    Joined:
    Jul 7, 2016
    Messages:
    2,354
    Likes Received:
    816
    well, it looks like Mellanox just jacked up the price. it was previously $4 per bracket; shipping was a bit high. they probably saw a sudden demand for it and changed the price...
     
    #80
Similar Threads: Mellanox MCX311A-XCAT
Forum Title Date
Great Deals Mellanox MCX311A-XCAT 10 Gigabit Ethernet Card w/Transceiver Low Profile - $65 Mar 4, 2017
Great Deals Mellanox ConnectX-3 on ebay look strange Oct 21, 2019
Great Deals Mellanox ConnectX-3 Pro (HPE) for $49.99 Oct 6, 2019
Great Deals Mellanox QSFP to SFP+ Adapter $10 Oct 1, 2019
Great Deals Mellanox 354A Pro $40 Jul 17, 2019

Share This Page