Windows 10 Pro for Workstations - RDMA

[zkrr01]

Just to be sure I followed the instructions in:
9.3. Configuring Soft-RoCE - Red Hat Customer Portal

[root@centos rxe0]# rxe_cfg status
  Name        Link  Driver     Speed  NMTU  IPv4_addr  RDEV  RMTU
  eth0        yes   hv_netvsc
  eth1        yes   hv_netvsc                          rxe0  1024  (3)
 
[root@centos rxe0]# ibv_devices
    device                 node GUID
    ------              ----------------
    rxe0                02155dfffe015288

[root@centos rdma_cm]# ibstat rxe0
CA 'rxe0'
        CA type:
        Number of ports: 1
        Firmware version:
        Hardware version:
        Node GUID: 0x02155dfffe015288
        System image GUID: 0x0000000000000000
        Port 1:
                State: Active
                Physical state: LinkUp
                Rate: 40 (FDR10)
                Base lid: 0
                LMC: 0
                SM lid: 0
                Capability mask: 0x00810000
                Port GUID: 0x02155dfffe015288
                Link layer: Ethernet

[root@centos rxe0]# cat /sys/kernel/config/rdma_cm/rxe0/ports/1/default_roce_mode
RoCE v2

[root@centos7 ~]# ibv_rc_pingpong -d rxe0 -g 0
  local address:  LID 0x0000, QPN 0x000011, PSN 0xb79399, GID fe80::215:5dff:fe01:528a

[root@centos rxe0]# ibv_rc_pingpong -d rxe0 -g 0 10.0.1.193
  local address:  LID 0x0000, QPN 0x000011, PSN 0x31b99b, GID fe80::215:5dff:fe01:5288
Couldn't connect to 10.0.1.193:18515

Does this indicate that Microsoft is preventing the ibv_rc_pingpong from completing since the server side is running on a workstation instead of a Microsoft server? Or is it something else I am doing wrong?

 

[saqibj]

Hello,
I wanted to mention that Chelsio Communications' 10-100GbE Unified Wire iWARP (RDMA/TCP)
adapters support Windows 10 Client RDMA capability. Windows 10 Enterprise Edition and
Windows 10 Pro for Workstations include inbox drivers for Chelsio Unified Wire iWARP drivers.

Following links provide more information regarding Chelsio iWARP adapters:

CHELSIO AND MICROSOFT COLLABORATE TO DEMONSTRATE WINDOWS 10 ENTERPRISE CLIENT SUPPORT OF iWARP RDMA (Press Release)
CHELSIO TERMINATOR 5 UNIFIED WIRE ADAPTERS ACHIEVE FIRST-TOMARKET DELIVERY OF WINDOWS 10 ENTERPRISE CLIENT RDMA SUPPORT (Press Release)
Create Advertising (Windows 10/iWARP Video Editing Case Study)
iWARP/RDMA Benefits in Windows 10 (Technical Brief)

Please reach out to me at saqibj@chelsio.com in case of questions and/or if you'd like to
evaluate Chelsio Unified Wire iWARP adapters.

thanks,

Saqib (Chelsio Marketing)

 

[kapone]

Seriously?

 

[saqibj]

Seriously?

Yes, absolutely, I'd be happy to answer any questions etc..

 

[MSX-fan]

So it is not possible to get even Windows 10 Enterprise in two different PCs with direct link cable to do RDMA with each other?

 

[saqibj]

I was wondering if you could share what is the application that you'll be using that
requires RDMA between the 2 Win10PCs?

 

[MSX-fan]

For example, if 2 separate users would like to share files with each other, but not make copies of them in the other PC. RDMA should help to reduce CPU usage so the transfers are more transparent even if both computers are used for high quality video edition at the same time.

 

[saqibj]

Chelsio T5 and T5 adapters support Network Direct (ND) enabling user-level RDMA communications between Windows 10 systems.
Please email "support@chelsio.com" for follow-up questions regarding the ND feature for Windows 10 systems.

 

[MSX-fan]

Hi,

is it so that T580 series cards are the only one, that are faster than 10GbE?

 

[i386]

It is disabled on all desktop and workstation licenses. Very annoying.

I think Microsoft and Mellanox finally fixed the issues; I can copy from a windows 10 enterprise (2004) client to a server 2019 using rdma.

 

[kiteboarder]

I think Microsoft and Mellanox finally fixed the issues; I can copy from a windows 10 enterprise (2004) client to a server 2019 using rdma.
View attachment 14490

They "half" fixed it. ;-)

I have two machines for testing:
a) Windows Server 2019
b) Windows 10 Pro Workstation

both fully updated as of today

Cases:
1) If you're on (b), you can copy a file from the (a) Server machine to (b) and RDMA works.

2) If you're on (a), RDMA does NOT work if you try to copy the same file from (a) to (b) (same direction as case 1).

So it seems Windows 10 Pro Workstation has been (somewhat) updated, but Server 2019 does not recognize Win 10 Pro W as a RDMA target.

Cheers

 

[donald24]

That's by design, RDMA-enabled shares can only be generated on server-products.

 

[eskiuzmi]

That's by design, RDMA-enabled shares can only be generated on server-products.

does that mean read from a server share will be at line speed but writing to it from windows workstation won't?

 

[donald24]

does that mean read from a server share will be at line speed but writing to it from windows workstation won't?

nope, direction of transfer is irrelevant.