Search results

looks Xyratex-compatible to me, I'd first go to 1.06 for both controllers and see how they perform. Has your 860 linked up at 6Gb/s or 3Gb/s? Also I'd look for 12G controllers, SAS2 feels dangerously old...

Congrats, thanks for sharing!

Yep, all of that plus firmware, I did not pull the trigger.

I used switchdev on regular CX5, it was working, there were additional parameters to be changed, something similar to these: https://github.com/Mellanox/switchdev-utils/blob/master/templates/firstboot/mellanox_fw_update.yaml#L7-L60 Are the basics covered? Firmware up to date? Can you manually...

Thank you for checking. In my personal opinion, some shorter post would be fine, not sure an article was worth it. Still, will be helpful for some.

Having fought with this some time ago, if the xceiver is not programmed for IB bits, it will hopefully link at SDR (2,5 Gbit/s x 4 = 10 Gbit/s) or not link at all. For a proper link, the xceiver needs to have IB bits, so replacing wrong xceiver is the way to go. Some Mellanox genuine xceivers...

What's that here? [ 10.039440] mpt2sas_cm1: LSISAS2008: FWVersion(06.00.00.00), ChipRevision(0x03) Here's the shelf reset, right? [ 156.034785] mpt2sas_cm1: mpt3sas_transport_port_remove: removed: sas_addr(0x500a098007664688) In general, I always run 2 controllers, there are no chassis...

Spent a lot of time on 9207-8e IT mode latest FW and IOM6, was rock solid in general. On reboots I saw the IOM "rearrange" the active slots, sometimes slots with disks won't have LEDs on (all with SAS->SATA Marvell adapters), which required pulling some adapters without disks for me. Then IOM...

Looks too physical to me :) have you tried checking the controller's IO pads and mid-plane pins, maybe vacuum the thing? Or adding force pushing the controller in? Is it only one controller giving you crap?

Could be many reasons for file transfer, usual suspects are MTU size and NIC buffers. I'd recommend to test with ib_send_bw (part of WinOF2) and nttcp (not iperf3 on Windows!) to exclude any disk issues.

what about basic tests like ibping/ib_send_bw? You can play with QP types and find out what the problem is.

Been a while...did you do an echo command like this: echo "id_ext=0002c903009f4480,ioc_guid=0002c903009f4480,dgid=fe800000000000000002c903009f4481" > /sys/class/infin iband_srp/srp-mlx4_0-1/add_target or a srpt command like this /srpt create 0xfe80000000000000001175000077dd7e based on...

All you need is mlxconfig to change the port mode from IB to Ethernet, no need to reflash the card. CX653105A supports both protocols (VPI).

sure looks like a rabbit hole, can't buy Minilake that easily, Facebook has not retired all Minipacks yet. But it seems they're throwing quite some early CX7s out. I'm still waiting to see one that supports QSFP-DD, I'm fairly sure it's QSFP112 based. (Upd. found some BCM957608) DX400 looks...

On ConnectX-6, if the firmware has a "secure-fw" flag, the sure way to reflash it is to use a MTUSB-1. On ConnectX-7 it's SOL right now, we need some ex-Mellanox with some insider knowledge to proceed. On ConnectX-8...hmm get me a CX8 and I'll tell you :) lol, probably the same as on CX7.

Hi werewolf, wondering what you're planning for NIC connectivity. ConnectX-6? Or CX7 with SR8 or DACs? Note that QSFP-DD DAC will not work on NIC's side (NICs require normal QSFP28/56/112).

Wow, glad I'm on STH, a lot of trash in that thread, with iperf3 on Windows and the like... Windows Client consuming Windows Server SMB shares over SMB Direct (RDMA) is a normal solution, SteamLibrary on a shared drive works without issues, and basically, it's not the most stupid solution. It...

Has been posted here on the forums, with mlxconfig on Linux, or with GUI on Windows. Correct, that's how all chassis work (storage or compute) - some blades, some midplane/backplane, some "control/network" blades that are connected to the same midplane.

yes. Convert ports to Ethernet and you're done. Or install a VPI switch additionally (SX6012/SX6036) to route between Infiniband and Ethernet.

there are Ethernet switches available for that chassis - MXL10/40 Gb and others. Take out IB blade(s), put Ethernet blades in. ConnectX3 blade AOCs will support both.