Search results

  1. M

    Mellanox ConnectX-3 help

    Thanks Chaps, I'll get stuck in :)
  2. M

    Mellanox ConnectX-3 help

    Survived Valentines day, I pretended to play dead, but it didnt work :D After a couple of days recovery, my back is a bit better now, so did a bit more testing and pulling a consistent 32-34Gbps. MTU size is 9014, but if there is anything else I need to adjust, I'm all ears :)
  3. M

    Mellanox ConnectX-3 help

    Absoloutely, but It's Valentines day here, and my wife may now need some attention, or I may live to regret it! :D
  4. M

    Mellanox ConnectX-3 help

    That was it!! I was just testing as you wrote, I don't ever remember messing with these settings at all :oops: Just did a quick test: iperf3 -c 192.168.10.3 -P 4 A BIG THANK YOU, to everyone who took the time and had the patience to deal with an idiot like me, I'm truley humbled! :)
  5. M

    Mellanox ConnectX-3 help

    Some wierd stuff going on....No pcie devices connected to mobo, set to GEN 3 in BIOS and card is still saying downgraded. Thanks for the help though as at least I know what the problem is now. :cool:
  6. M

    Mellanox ConnectX-3 help

    I have just double checked bios and it's set to gen 3, and I also tried 'Auto'. lspci -vvv gave the same output for both, so I'm not sure why it is being downgraded. I do have a pcie 2.0 SAS card on the second slot (@x8), I will remove this and see if if that is the culprit. Thank you
  7. M

    Mellanox ConnectX-3 help

    output on unraid: Info from W11:
  8. M

    Mellanox ConnectX-3 help

    I have just noticed one of the cards is infact Rev.A8 and one is Rev.A3 Does this matter? As firmware mentions A2-A5 and I cannot find any other version?
  9. M

    Mellanox ConnectX-3 help

    One card is in the top x16 slot running at x8 speed, the other card is in the second x16 slot running at x8 speed. All are PCIE 3.0
  10. M

    Mellanox ConnectX-3 help

    I'm going to change the CPU to a 10600k tonight when I get home from work, then swap out the cable as a last resort.
  11. M

    Mellanox ConnectX-3 help

    Both motherboards are Z490 so pcie 3.0 Both slots are x8, one shared with a GPU @x8, the other shared with a SAS 6gbps pcie 2.0 card.
  12. M

    Mellanox ConnectX-3 help

    With 5 instances open, only 15Gbps :eek: using: -c 192.168.10.3 -T s1 -w 32M -p 5101 -t 50 & etc....
  13. M

    Mellanox ConnectX-3 help

    Ubuntu live exactly the same, :( Just to confirm on the unraid side 40g link speed also:
  14. M

    Mellanox ConnectX-3 help

    OK I'll give that a whirl first
  15. M

    Mellanox ConnectX-3 help

    Thanks, checked lots of the threads regarding this, and still can't see anything wrong with my set up. I'm going to double check both machine BIOS settings and swap out the unraid machines CPU. Its currently an i3 10100, so I'll replace it with an i5 10600k. The W11 machine has a 10700k. Both...
  16. M

    Mellanox ConnectX-3 help

    Is the problem maybe my cable? What is the difference between the one I have (FDR10) and the 40GBE one? Does the FDR10 cable split 4x10, and the other doesnt? Could that be my problem?
  17. M

    Mellanox ConnectX-3 help

    Unfortunatley I only have a Windows and unraid machine to hand, I could create a Windows VM on unraid but not sure if it would work as good as bare metal?
  18. M

    Mellanox ConnectX-3 help

    Tried that and went down to 6Gbps :( I have an i5 10600k sat around, so over the next couple of days, i'll swap it out and rule out the cpu, as its currently an i3. It's so frustrating o_O
  19. M

    Mellanox ConnectX-3 help

    Unraid side I tried: iperf3 -s -p 4500& iperf3 -s -p 4501 W 11 Client side i ran two instances: iperf3.exe -c 192.168.50.5 -p 4500 -t 50 iperf3.exe -c 192.168.50.5 -p 4501 -t 50 this was recommended on the unraid forum.
  20. M

    Mellanox ConnectX-3 help

    Hi, With single iperf = 13Gbps and with two instances running 6Gbps ish each