So, through much blood, sweat, and tears, I have my NAS and ESXi recognizing their new-ish ConnectX-3 cards in IB mode. I can send pings across the links and everyone looks happy. However, after adding my NFS storage to ESXi, I am now having another problem. Access to the NFS share from ESXi is sporadic at best and non-existent at worst. I am getting the following error messages on the NAS server:
Dec 28 15:36:54 san kernel: ib_srpt rejected SRP_LOGIN_REQ because target port mlx4_0_1 has not yet been enabled
Dec 28 15:36:54 san kernel: ib_srpt Rejecting login with reason 0x10001
Dec 28 15:36:54 san kernel: ib_srpt Received SRP_LOGIN_REQ with i_port_id 651e:2d03:00b7:5672:24be:05ff:ff9e:8e41, t_port_id e41d:2d03:00b7:5670:e41d:2d03:00b7:5670 and it_iu_len 580 on port 2 (guid=fe80:0000:0000:0000:e41d:2d03:00b7:5672); pkey 0xffff
Dec 28 15:36:54 san kernel: ib_srpt rejected SRP_LOGIN_REQ because target port mlx4_0_2 has not yet been enabled
Dec 28 15:36:54 san kernel: ib_srpt Rejecting login with reason 0x10001
I have exhausted my google-foo and this error hasn't really led me anywhere helpful. Any thoughts are appreciated.
As far as the NAS server goes, it is a stock CentOS 6.7.
- yum update
- yum groupinstall "Infiniband Support"
- systemctl enable rdma
- configure IB interfaces and verify pings are working to ESXi.
Thanks.
Dec 28 15:36:54 san kernel: ib_srpt rejected SRP_LOGIN_REQ because target port mlx4_0_1 has not yet been enabled
Dec 28 15:36:54 san kernel: ib_srpt Rejecting login with reason 0x10001
Dec 28 15:36:54 san kernel: ib_srpt Received SRP_LOGIN_REQ with i_port_id 651e:2d03:00b7:5672:24be:05ff:ff9e:8e41, t_port_id e41d:2d03:00b7:5670:e41d:2d03:00b7:5670 and it_iu_len 580 on port 2 (guid=fe80:0000:0000:0000:e41d:2d03:00b7:5672); pkey 0xffff
Dec 28 15:36:54 san kernel: ib_srpt rejected SRP_LOGIN_REQ because target port mlx4_0_2 has not yet been enabled
Dec 28 15:36:54 san kernel: ib_srpt Rejecting login with reason 0x10001
I have exhausted my google-foo and this error hasn't really led me anywhere helpful. Any thoughts are appreciated.
As far as the NAS server goes, it is a stock CentOS 6.7.
- yum update
- yum groupinstall "Infiniband Support"
- systemctl enable rdma
- configure IB interfaces and verify pings are working to ESXi.
Thanks.