Been having a bit of an issue getting EoIB up and running on a Solaris box.
I have been looking at various guides an have had it running until I had to rebuild the SAN.
The problem seems to be between getting the IP network devices created.
The main guide I have been following is from Oracle and can be found here.
The SAN has a QDR Connectx-2 card. Port 1 is damaged so I am using port 2. I have also tried with a DDR card on port 1 with the same issue. The problem persists whether the cable is plugged in or not.
The issue is that the eoip device once created manually will not come up.
Command being used to create the eoib device
"voltaire-4036" is based on the return from my switch and "0a-eth-1 " is just taken from guides.
From ifconfig -a
but this results in
I have reinstalled Solaris a couple of times now and this is getting really frustrating especially as the original time I followed a guide I did not save the link to and it just worked.....
Suggestions on what may be going wrong and how to fix it ?.
I have been looking at various guides an have had it running until I had to rebuild the SAN.
The problem seems to be between getting the IP network devices created.
The main guide I have been following is from Oracle and can be found here.
The SAN has a QDR Connectx-2 card. Port 1 is damaged so I am using port 2. I have also tried with a DDR card on port 1 with the same issue. The problem persists whether the cable is plugged in or not.
The issue is that the eoip device once created manually will not come up.
Code:
root@San:~# dladm show-phys
LINK MEDIA STATE SPEED DUPLEX DEVICE
net3 Infiniband up 32000 unknown ibp1
net2 Infiniband down 0 unknown ibp0
net1 Ethernet up 1000 full e1000g1
net0 Ethernet up 1000 full e1000g0
Code:
root@San:~# dladm show-ib net3
LINK HCAGUID PORTGUID PORT STATE GWNAME GWPORT PKEYS
net3 2C903005169F8 2C903005169FA 2 up -- -- FFFF
Code:
root@San:~# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
inet 127.0.0.1 netmask ff000000
net0: flags=100001004843<UP,BROADCAST,RUNNING,MULTICAST,DHCP,IPv4,PHYSRUNNING> mtu 1500 index 8
inet 192.168.2.118 netmask ffffff00 broadcast 192.168.2.255
etherx:xx:xx:xx:xx:d8
net1: flags=100001004843<UP,BROADCAST,RUNNING,MULTICAST,DHCP,IPv4,PHYSRUNNING> mtu 1500 index 6
inet 192.168.2.117 netmask ffffff00 broadcast 192.168.2.255
ether x:xx:xx:xx:xx:d9
lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> mtu 8252 index 1
inet6 ::1/128
net0: flags=120002004841<UP,RUNNING,MULTICAST,DHCP,IPv6,PHYSRUNNING> mtu 1500 index 8
inet6 fe80::225:50ff:fe59:bad8/10
ether x:xx:xx:xx:xx:d8
net1: flags=120002004841<UP,RUNNING,MULTICAST,DHCP,IPv6,PHYSRUNNING> mtu 1500 index 6
inet6 fe80::225:50ff:fe59:bad9/10
ether x:xx:xx:xx:xx:d9
Code:
dladm create-eoib -l net3 -g voltaire-4036 -c 0a-eth-1 eib1
Code:
root@San:~# ibswitches
Switch : 0x0008f10500109582 ports 36 "Mellanox 4036 # voltaire-4036" enhanced port 0 lid 1 lmc 0
Code:
eib1: flags=1000803<UP,BROADCAST,MULTICAST,IPv4> mtu 1500 index 12
inet 10.0.0.1 netmask ffffff00 broadcast 10.0.0.255
ether 0:0:0:0:0:0
Code:
root@San:~# ipadm show-addr eib1
ADDROBJ TYPE STATE ADDR
eib1/v4 static inaccessible 10.0.0.1/24
Suggestions on what may be going wrong and how to fix it ?.