Beware - Emulex 10GbE Virtual Fabric Adapter II x8 PCI-E slot

[Terryng]

Dear Stanza,
I have been trying to get the same card working but failed. The ethtool reported that there is no link detected. You have mentioned that you did something in the bios to get the link up. Much appreciated if you could share with us please.

I am using Ubuntu 16.04. The driver is be2net. The card is from IBM and it is a OC10 series with fw 10.0.803.31. I am using a Quanta LB6M switch and CISCO SFP-H10GB-CU3M 3M TWINAX COPPER cable.

Thank you in advance.

Regards,
Terry

 

[Kaytro]

I managed to get the cards working without needing to reset the port on startup.

Update the cards to the 11.x firmware from broadcoms website and then disable all of the DCBx features from the One command CNA manager. Reboot and using the CNA manager, disable then re-enable the port. Verify all of the DCBx features are disabled. Reboot and check to see if the ports are online.

 

[mytime34]

I bought a pair of these and I am able to enable the port in windows with CNA, but if I unplug or reboot the link goes down. I have updated to 11.4 fw and it gives me lots of options, but no option for link enabled. Is there any work around?
I am also trying this card in unraid and it is detected and showing be2net driver, but power on or power down of the port does nothing. I may have to upgrade to a different card.

In windows when it is enabled I am getting 990mbs transfer between 2 computers via DAC or fiber, I was hoping to bond then for higher throughput.

 

[Sickculture]

Anybody get a IBM Emulex 49Y7942 working in VMWare ESXI 6.7? The card show with elnex driver and ports are green with signal. But i can't connect.

 

[mariog]

Forcing the Interface Speed to 10GB instead of default also gives a link with the manager under Windows.

Ethtool cannot set the speed, is there another tool for linux tot set the speed?

 

[SirGreedy]

I am just here to say: thank you so much my dear sir!

After so much frustration with no link signal at all, I bumped into your thread eventually. I was using the newest version of Emulex OneCommand Manager (and now they renamed it to "HBA manager"), and just simply cannot find my 49Y7942 card.

The "elxocm-windows-x64-10.0.803.9-1" included in your Google Drive folder is the savior. After unable/enable the ports, just as what you have described, the link is on!!

I am so happy and so grateful.

Hmmm ok had another play tonight

thought I would try and find an older firmware, specifically from IBM for these cards.... not the Emulex firmware that they generally direct you to.

found a different firmware,

cards originally were

1st card was firmware version 4.2.412
2nd card was older at 3.x.xx

updated both originally with the emulex firmware ver 10.0.803.31

Both cards and transceivers wouldn't get a link

so now I found IBM Firmware 10.2.261.36-1

applied that in windows, connected port 0 to port 1 and got a link up

applied the same firmware to the 2nd card, installed ubuntu 12.04.........connect cable between the two servers (port 0 on each) and back to the link down status

fiddled around in the bios and changed the port status's to disabled, then back again to enabled........boom 10gbps link

exit bios and reboot....link light still on (good sign)

boot into ubuntu 12.04 live usb.......link is still up.

quick ping and a samba copy test to the windows box.......good it's working

so now installing ubuntu 12.04 properly to see what happens

pretty happy, even if it's only testing at present.... and lots to learn and configure yet. (kind of wish I found this before I forked out for the DAC cables that are on route....but meh I still need one more cable at minimum)

total cost so far

2 x IBM 49Y7942 = $100 + $8 postage
3 x SFP+ Transceivers = $31.63 + $6.15 postage
2 x LC>LC Cables Free already owned them

Total $145.78

3 x DAC Cables still to arrive $155.71 >>> more than the working lot above

Might have to offload a couple of the DAC cables to recoup some costs

 

[EasyRhino]

So this super old thread was super useful to me.

I recently picked up two of the Emulex oce11102-n-xi cards for $15 each off ebay.

I only put them in x16 slots so I didn't have any physical fit problems.

I DID have the problem of them showing "link down" and no lights on when I plugged in two cards via a DAC cable that everyone else has had. And disabling/enabling (or forcing a speed in esxi) worked to enable it.

I almost wonder if the problem could be in SFP+ compatibility? Because even in the ctrl-p bios screen it shows as "link down". And this IBM page made it sound like the cards are really picky on their SFP+ compatibility:

Support list matrix for SFP and Twinax DAC cables - Converged Network Adapter

Link flapping, Light Emitting Diodes (LEDs) not illuminating, and other connectivity issues may occur when installing untested, unsupported Small Form-factor Pluggable (SFP) transceivers and Twinax/Direct Attached Copper (DAC) cables in Converged NetworkAdapters (CNA).

www.ibm.com

I managed to get the cards working without needing to reset the port on startup.
Update the cards to the 11.x firmware from broadcoms website and then disable all of the DCBx features from the One command CNA manager. Reboot and using the CNA manager, disable then re-enable the port. Verify all of the DCBx features are disabled. Reboot and check to see if the ports are online.

I wish I could get this working, but mine still shows link down even when I disable the DCBx and LLDP settings. Basically, for my windows desktop, if it goes to sleep or if I shut down/reboot it, then I'm going to show link down until I do a disable/enable.

 

[gtcdma]

I've been desperately trying to get one of these NICs (49Y7942) to work on Ubuntu 18.04 and had the same "link down" issue.
Tried different firmware versions and settings, but no luck.

Until I suddenly found out that running the ethtool test activates the link:

sudo ethtool -t enp1s0f0
sudo ethtool -t enp1s0f1

So I've added this command to /etc/network/interfaces and now the link comes up at boot as expected:
auto enp1s0f0
iface enp1s0f0 inet dhcp
pre-up ethtool -t enp1s0f0

It's on IBM Firmware 10.2.261.36-1, be2net driver version 12.0.0.0.

It works fine with a passive DAC cable (Arista CAB-SFP-SFP-2M) as well as Cisco SFP-10G-SR
I haven't noticed any performance issues so far.

 

[antenagora]

I've been desperately trying to get one of these NICs (49Y7942) to work on Ubuntu 18.04 and had the same "link down" issue.
Tried different firmware versions and settings, but no luck.

Until I suddenly found out that running the ethtool test activates the link:

sudo ethtool -t enp1s0f0
sudo ethtool -t enp1s0f1

So I've added this command to /etc/network/interfaces and now the link comes up at boot as expected:
auto enp1s0f0
iface enp1s0f0 inet dhcp
pre-up ethtool -t enp1s0f0

It's on IBM Firmware 10.2.261.36-1, be2net driver version 12.0.0.0.

It works fine with a passive DAC cable (Arista CAB-SFP-SFP-2M) as well as Cisco SFP-10G-SR
I haven't noticed any performance issues so far.

I can confirm this, even with firmware oc11-12.0.1280.0.ufi from:

Software Details | HPE Support Center

support.hpe.com

rebooting gives me a "link up" but powering off the server gives me the usual "link down".

I wold like to use this adapters in truenas or freebsd but i am not able to find something like ethtool to make le nic reset and test the network speed.

Does anybody know if brcmhbacmd is available on *BSD ?