I passed age 60, my memory is fading. So I write a lot of notes for myself to read later.
Otherwise, I would have to spend at least an hour to performing the same experiment again.
Version 2.9.8350 is the right one to flash,
I remembered that I got the ~ $20 MNPH29C-XTR cards to work with RDMA in a WS2016 cluster, what a joy to see that happened.
, car you share the steps how to enable rdma in ws2016?
I have done the follow steps:
1.flash the firmware to 2.10.0720
2.install windows server 2019
3.install latest winof driver from mellonax
4.follow the steps:Configure RDMA over Converged Ethernet (RoCE) / PFC on Windows Server 2019
but i can't complete the step of Enable QoS on adapters: the command of Get-NetAdapterQos return nothing, and may be due to that, i still can't get rdma work.
BTW, the result of Get-NetAdapterRDMA shows that PFC and ETS are N/A, just like this(which posted by TeleFragger
does it mean that this nic doesn't support pfc?(seems that pfc is required by roce)
Finally they are working now. The key is that roce should be set to 1, see:https://community.mellanox.com/s/article/howto-configure-roce-in-windows-environment--global-pause-x
But before execute the command of Set-MlnxDriverCoreSetting, may be you should execute the follow commands:
Set-ExecutionPolicy -ExecutionPolicy Unrestricted -Scope Process
or you will get the error:
Get-MlnxDriverCoreSetting : The term 'Get-MlnxDriverCoreSetting' is not recognized as the name of a cmdlet