mellanox connectx-3 windows 10 issue

[krustylicious]

Newbie post .. And also a newbie to sfp+ land.

Hi,

So i have two issues, one of which i will sort out in another thread, as not to confuse myself or you guys.

So the mellanox connectx-3 is sitting in a pcie 3.0 x8 port on an x570 gigabyte mobo. That should be ok with bandwidth.

My problem is this: i can only ping the other machine.

I have a solarflare 7122f in another machine (192.168.100.2) and is directly connected to the mellanox (192.168.100.50)

1. Device manage loads its inbuilt driver ok (i know nvidia has better drivers)
2. the Mellanox is seen in the old network control panel but not in the new settings one under ethernet.

3. I can't browse any shares on the 192.168.100.2 connection via 192.168.100.50 but i can ping from 192.168.100.50 to 192.168.100.2

4. iperf won't work on this connection.

5. i brought the mellanox from ebay to fault resolve a solarflare issue (which is another thread)

I need a little bit of paw helping to resolve

 

[i386]

what cx-3 model?
vpi, ib or ethernet mode?

 

[krustylicious]

this in device manager

Device MLX4\ConnectX-3_Eth\5&4f350c1&0&02

how do i check if its in vpi mode in windows, if i have to use a linux live cd which should i use? i don't think its in infiniband mode?

The trancievers are hpe sr mm modules - which should be fine(as long as they aren't duff)

 

[Renat]

Model is written on card.
IF ONLY this is VPI model (MCX354)
in "System Devices" there is "......Mellanox...mt4099......" when you can change settings: auto (default IB, Ethernet, IB).

but maybe this is only ethenet MCX314 model.

is 7122f SFP+ model? then how did you connect it to QSFP port on ConnectX-3? card itself can`t use breakout cable (if I remember)


But of course all other problems with pings and networks shares cause of no routing setup between netoworks.

 

[krustylicious]

when windows fails stickers on the card helps

cx322a

p/n 0w0rm9 rev8

 

[Renat]

then our questions is not major.

looking for manual to setup routing between networks with "route" command in windows.
or make a Bridge in "network settings" with your "network-internet" card and Mellanox-card (or Solidfire: depends which one in network)

of course we not mentioned if "shared networks" service doesn` run on both "PC" and no firewall blocks data transfer.

 

[krustylicious]

I believe w10 is seeing the cx322a as a virtual driver as my antivirus is classing it as a virtual connection.

 

[krustylicious]

Update. the Mellanox card is now in one of my other pcs, and is still not properly seen in windows.

and
"
Connecting to host 192.168.10.66, port 5201
[ 5] local 192.168.10.25 port 54196 connected to 192.168.10.66 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.01 sec 768 MBytes 6.37 Gbits/sec
[ 5] 1.01-2.01 sec 963 MBytes 8.10 Gbits/sec
[ 5] 2.01-3.01 sec 1022 MBytes 8.59 Gbits/sec
[ 5] 3.01-4.01 sec 1.01 GBytes 8.58 Gbits/sec
[ 5] 4.01-5.01 sec 1.01 GBytes 8.66 Gbits/sec
[ 5] 5.01-6.01 sec 1020 MBytes 8.59 Gbits/sec
[ 5] 6.01-7.01 sec 1006 MBytes 8.44 Gbits/sec
[ 5] 7.01-8.01 sec 1.01 GBytes 8.61 Gbits/sec
[ 5] 8.01-9.01 sec 1.01 GBytes 8.72 Gbits/sec
[ 5] 9.01-10.01 sec 1.01 GBytes 8.65 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.01 sec 9.71 GBytes 8.33 Gbits/sec sender
[ 5] 0.00-10.05 sec 9.71 GBytes 8.29 Gbits/sec receiver

"

Thats windows to linux. I was reading the manual, and it said that amd eypc 2 has to use WinOF-2 , and as both of my machines are amd based (ryzen), is this the reason its not working properly in windows ? But of course the cx322A's can't use the newer winof2 only winOF..

 

[MountainBofh]

As a test, boot the Windows machine up on a USB drive with a linux distro with a fairly up to date kernel, and see if anything speed wise changes. That will rule out Windows issues or Window driver issues.

 

[krustylicious]

As a test, boot the Windows machine up on a USB drive with a linux distro with a fairly up to date kernel, and see if anything speed wise changes. That will rule out Windows issues or Window driver issues.

the problem is with windows, using linux in this situation will resolve if the card is faulty. which is what i've done

[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.01 sec 9.71 GBytes 8.33 Gbits/sec sender
[ 5] 0.00-10.05 sec 9.71 GBytes 8.29 Gbits/sec receiver

Thats from windows to linux.

the image attatched shows the issue inside of windows. It shows in the old network connections, in ipconfig etc. but not in
the new windows 10 networking & internet settings. Its being classed as a virtual adaptor, i've turned off sr-iov in the bios and windows settings yet nothing has changed