Search results

  1. N

    Mellanox/EMC SX6012 - Revival Attempt

    Possibly no PCIe link to the underlying SwitchX2 board, mft can’t start, or driver has trouble accessing registers. You might want to add mft to the mini image or check lspci somehow to confirm this.
  2. N

    Mellanox/EMC SX6012 - Revival Attempt

    I’m still thinking the issue is before the boot loader. I would measure the outputs of both PSUs, if they’re okay I would unmount the PPC daughter board and check if the fans work okay and there’s activity on the base board (maybe try I2C). Only then I’d continue checking the daughter board...
  3. N

    Mellanox/EMC SX6012 - Revival Attempt

    No status lights, dead console? I’d start from power, check the boards for signs of damage, check PSU by PSU. Lots of tinkering probably with unpredictable results.
  4. N

    Mellanox SX6790 FDR

    Interesting, looks like fw-sx-9_4_2000-MSX6025F_Bx should have been used instead - revision B which is SwitchX-2. Revisions A and B for Mellanox seem to mean worlds apart (ConnectX-2 DDR is A1, ConnectX-2 QDR is B0 AFAIR).
  5. N

    Mellanox SX6790 FDR

    Hmm, maybe port 0 has to be updated as well for FDR, or some other piece is missing. You can’t skip analyzing the diff between this .ini and the original Mellanox .ini - Firmware for a SwitchX® Switch System doesn’t require any contract
  6. N

    Mellanox SX6790 FDR

    You download the image for SX6025 from Mellanox, and run the same command on that downloaded image. Haven’t crossflashed an unmanaged switch yet, but I believe the flash holds 2 images same as in HCAs. You can’t easily edit the existing firmware - either you need to know the binary and patch...
  7. N

    Mellanox SX6790 FDR

    Hey, as expected, the limitation is in firmware: ib_speed_support=SDR_DDR_QDR Check diff for the same dc command from original Mellanox 6025 firmware - shouldn’t be too far apart, and you can try crossflashing. If it’s really far apart (ports and lanes, polarity don’t match for the majority of...
  8. N

    Mellanox SX6036 10/100 Question

    Less than 1G didn’t work for my SX6012, I think it’s just not supported by the switch, transceivers are capable.
  9. N

    Help! ConnectX-4 Lx Not Working in Windows 10

    Hmm, for me a PCIe x1 from PCH and a CX3 works fine. Defeating the purpose of a high-speed interconnect, of course.
  10. N

    Direct attach with MCX354A-FCBT

    Hmm, normally DAC is recognised as Direct Attach Copper and Auto-Negotiation on is set. I would also try IB and a different firmware.
  11. N

    Mellanox NICs

    A "Cross-flash" ✔ or ✖ mark for OEM cards would be helpful.
  12. N

    Query about 32G FDR adapter speed.

    Just high transfer speeds can be reached without RDMA, you can test with iperf or NTtcp. nd in the name of the utility probably hints that NetworkDirect has to be present and enabled on the adapter, which is again Windows Server/W10 Pro for Workstations. RDMA is needed to save CPU resources...
  13. N

    Query about 32G FDR adapter speed.

    nd_send_bw.exe is the one. One side’s a server, the other a client. There’s a huge gap between the standard SMB transfer speed and the max throughput available, and there’s a thread about that too.
  14. N

    Query about 32G FDR adapter speed.

    Paste “ibstat” output here. I recommend tests with IB_send_bw which is shipped with that OFED. On a Linux vanilla box without much tuning you can normally get ~26G on ConnectX-2. On Windows 10 slightly less, but I tested over a year ago last time. The biggest factors are PCIe lanes (is it x8 in...
  15. N

    Issue with Mellanox Connectx-3 MCX341-A NIC not being picked up by mobo

    Thanks for the feedback, now I know that Gigabyte leaves you SOL with PCIe configuration. Easiest way - find another PC to test it on. I would expect something early on from a working card - legacy Flexboot (iPXE) or beta UEFI could be on it, also I wouldn’t trust consumer BIOS to provide you...
  16. N

    Infiniband Question

    I’d stay away from QDR in 2020, FDR HCAs cost about 20$ more, and some of the FDR switches I’ve seen were even cheaper than QDR. Add to that better driver support, and 40G Ethernet mostly out of the box. My next lab will be with EDR/HDR products and interesting offloads.
  17. N

    Mellanox SX6790 FDR

    Back up current image with mstflint -ri abc.bin; you still haven't provided the config dump (mstflint dc). In the config dump max supported speeds should be visible.
  18. N

    Split QSFP+ without splitter cale

    Yes, I should’ve written “absolute majority” of the cards don’t support splits. For the notorious XL710-QDA2, not only second port won’t work, but you’ll be trying your luck with the offloads. I’m also interested in the performance of these cards - of course, single stream will be limited to...
  19. N

    Split QSFP+ without splitter cale

    Has been discussed here many times already - you can split a port on the switch, but not on the NIC. On the switch, a 40g interface is destroyed, and 4 new interfaces are created, 10G lanes are re-mapped to the new interfaces. You can do it switch-to-switch this way. On the NIC, there’s just 1...
  20. N

    Help with Connect X2 VPI, Server 2019, and Aruba S2500 switch

    Seems to be one of the oldest CX-2s, with the latest firmware. There might be some issues with S2500 actually. Do you have the DAC sitting tight in SFP+ to QSFP adapter?