Solarflare SFN5122F unrecognised

[Shenko]

Hello all, I wonder if someone could help me. I've just purchased 4 solflareSFN5122F cards and I'm trying to get them installed both on windows and Linux, I'm new to 10gb networking and these were going cheap / untested so I thought I would take a punt on them, they are all in good physical condition

My difficulty is that the adptors don't show up in device manager, I'm using windows 10 and I have installed the software located here :-
Windows
When I boot the machine I see the link lights blin briefly and then go out.

When I run a solarflare system report using the solflare software it shows as if the devices aren't even present


I also installed the cards in a linux machine and they don't show under lspci is there something I need to do from within the bios that might be preventing these devices being seen by the system?


Both systems are running modern Asus motherboards.
Crosshair v1 hero and an asus strix Z270H

Any help or suggestions would be appreciated.
Tia.
M

 

[altmind]

Can you check if sfc devices are present using a linux livecd?

 

[Shenko]

Hey Altmind, I can certainly whip in a live cd and give it a whirl. Even without the modules wouldn't lspci still report back a device ?
I will report back shortly

 

[Shenko]

Here's the output of lspci

lspci
00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core Processor Host Bridge/DRAM Registers (rev 05)
00:01.0 PCI bridge: Intel Corporation Skylake PCIe Controller (x16) (rev 05)
00:01.1 PCI bridge: Intel Corporation Skylake PCIe Controller (x8) (rev 05)
00:14.0 USB controller: Intel Corporation 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller
00:16.0 Communication controller: Intel Corporation 200 Series PCH CSME HECI
00:17.0 SATA controller: Intel Corporation 200 Series PCH SATA controller [AHCI mode]
00:1b.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port (rev f0)
00:1b.4 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port (rev f0)
00:1c.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port (rev f0)
00:1c.2 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port (rev f0)
00:1c.4 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port (rev f0)
00:1d.0 PCI bridge: Intel Corporation 200 Series PCH PCI Express Root Port (rev f0)
00:1f.0 ISA bridge: Intel Corporation 200 Series PCH LPC Controller (Z270)
00:1f.2 Memory controller: Intel Corporation 200 Series/Z370 Chipset Family Power Management Controller
00:1f.3 Audio device: Intel Corporation 200 Series PCH HD Audio
00:1f.4 SMBus: Intel Corporation 200 Series/Z370 Chipset Family SMBus Controller
00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection (2) I219-V
01:00.0 VGA compatible controller: NVIDIA Corporation GP107 [GeForce GTX 1050 Ti] (rev a1)
01:00.1 Audio device: NVIDIA Corporation GP107GL High Definition Audio Controller (rev a1)
04:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981
06:00.0 SATA controller: Marvell Technology Group Ltd. Device 9215 (rev 11)
07:00.0 USB controller: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller

I used modprobe sfc to load the module

lsmod | grep sfc


sfc 360448 0
mdio 16384 1 sfc
mtd 69632 1 sfc


modinfo sfc


filename: /lib/modules/4.19.0-5-amd64/kernel/drivers/net/ethernet/sfc/sfc.ko
version: 4.1
license: GPL
description: Solarflare network driver
author: Solarflare Communications and Michael Brown <mbrown@fensystems.co.uk>
srcversion: C73D50B4862884B27897758
alias: pci:v00001924d00001B03sv*sd*bc*sc*i*
alias: pci:v00001924d00000B03sv*sd*bc*sc*i*
alias: pci:v00001924d00001A03sv*sd*bc*sc*i*
alias: pci:v00001924d00000A03sv*sd*bc*sc*i*
alias: pci:v00001924d00001923sv*sd*bc*sc*i*
alias: pci:v00001924d00000923sv*sd*bc*sc*i*
alias: pci:v00001924d00001903sv*sd*bc*sc*i*
alias: pci:v00001924d00000903sv*sd*bc*sc*i*
alias: pci:v00001924d00000813sv*sd*bc*sc*i*
alias: pci:v00001924d00000803sv*sd*bc*sc*i*
depends: mdio,mtd
retpoline: Y
intree: Y
name: sfc
vermagic: 4.19.0-5-amd64 SMP mod_unload modversions
sig_id: PKCS#7
signer: Debian Secure Boot CA
sig_key: A7:46:8D:EF
sig_hashalgo: sha256
signature: 57:58:7B:40:FB:87:46:3B:AE:F1:90:9C:4F:AA:42:63:A3:26:11:10:
04:C9:F3:94:4E:16:B1:99:E7:56:00:9D:57:9B:0B:F7:E4:40:92:8F:
2D6:3C:09A:08:85:B2:42:FF:88:92:51:E4:87:A9:C2:7A:40:0B:
D1:1C:7E:23:89:E9:3D:92:42:206:76A:292:1D:9D:A0:86:94:
10:53:97:6A:ED:C8:F5:0CD:A4:40:AF:3A:87:4A:99:C8:4D:B8:68:
5D:E2:4A:53:EB:77:46:72:92C9:30:79D:B1:6A:67:C3:09:17:
68:07:AD:69:19:92:84:2B:A4:14:7E:A5:E2:AC:6F:08:91:39:18:F4:
83:7A:EB:2B:39:03:2C:EF:84:4F:02:BD:99:E9:94:84:33:B7:B2:F1:
D3:96:C2:60:F2:4A:57:7F:AE:2A:6C:AF:3B:91:CC:AE:2E:27:E8:C8:
21:AD3:0A:51:2E:1A:40:25:37:CF:3E:7B:C1:9F:A9:EAA:1F:63:
D9:1D:34:C9:89:012:B5:6E:05:21:97:97:51:79:0F:00:3C:85:9B:
BD:17:9C:EF:B0:35:AF:44F:66:73:40:72:BC:3D:FB:929:A4:0B:
36:4E:070:E8:37BF:FF:C6:F7:8E:79:62:42:65
parm: vf_max_tx_channels:Limit the number of TX channels VFs can use (uint)
parm: max_vfs:Reduce the number of VFs initialized by the driver (int)
parm: mcdi_logging_default:Enable MCDI logging on newly-probed functions (bool)
parm: rx_refill_threshold:RX descriptor ring refill threshold (%) (uint)
parm: efx_separate_tx_channels:Use separate channels for TX and RX (bool)
parm: rss_cpus:Number of CPUs to use for Receive-Side Scaling (uint)
parm: phy_flash_cfg:Set PHYs into reflash mode initially (bool)
parm: irq_adapt_low_thresh:Threshold score for reducing IRQ moderation (uint)
parm: irq_adapt_high_thresh:Threshold score for increasing IRQ moderation (uint)
parm: debug:Bitmapped debugging message enable value (uint)
parm: interrupt_mode:Interrupt mode (0=>MSIX 1=>MSI 2=>legacy) (uint)

 

[altmind]

do you see anything about solarflare pxe(or anything from solarflare oprom) on boot before post screen?
now it looks to me like either dead cards or pci slots.

if you can obtain sfutils(or windows equivalent), you can try `sfcboot -c` `sfcboot -r` (but this have only slim chance to help since the device files are not created)

you provided a link to driver downloads, you used "SFN5000, SFN6000, SFN7000 and SFN8000 series adapters", right? they dont claim windows 10 compatibility for the older drivers.

 

[Shenko]

Thanks for getting back to me.
I don't see anything about solarflare pxe prior to post screen, I downloaded sfutils rpm converted to .deb using alien and attempted to use the options mentioned, each time it complained about not being able to find an adapter. What's the chances that all 4 cards are dead. I know the pci ports are ok as I've tested other devices in them.

Tia.

 

[cesmith9999]

try taping off a few of the PCIe pins (look in the HBA forum for which ones). this may be the same issue that some HBA cards have with consumer gear.

Chris

 

[Shenko]

Forgive me Chris. I tried to find the forum post but was unsuccessful. Can you please point me in the right direction. Thanks M

 

[Markess]

This won't fix your issue, but can be helpful for diagnostics. These BIOS settings may help you identify what the issue is, regardless of OS, be it Windows or Linux. If you do get it to work, you may (probably will) want to change these back selectively, but for diagnostics they may help to make your system as "compatible" as possible. You may have done some of these already, but just in case:

In your BIOS Boot menu:
1) "Fast Boot" to Normal Boot, this ensures all the devices load fully. With fast boot, some devices can continue to load after Windows starts loading, and older hardware (like your 10G NIC), can get confused or overlooked). I've also found that Linux doesn't like fast boot much either regardless of the hardware (just my anecdotal observation, may not be an issue for linux at all!)
2) "Boot Configuration/Boot Logo Display" to Disabled (so you can see ALL the boot messages),
3) "Boot Configuration/Option ROM Messages" to Enabled. You don't need the Option ROM loaded to use the card. But if the Option ROM on the card can't be read at boot, that's an issue in itself. With this set to "enabled", you should see a line or two saying something about the Solarflare BIOS/ROM pop up during the boot process. IF you do see a message, check out the firmware level. You may have a really old firmware that is contributing to the problem
4) "Boot Configuration/CSM" "Launch CSM" to enabled, and then select "Enable UEFI and Legacy devices" for "Network" and "PCI_E devices". You don't need this necessarily either in normal use, but this helps cast a wide net for compatibility while you troubleshoot. If you do get the card recognized and working, then you can selectively tighten up on the options again.

In your BIOS Onboard Devices menu: Tinker around with your PCIE slot modes. If your slots are set to "Auto" or "Gen 3" your motherboard SHOULD automatically negotiate the speed downward to Gen 2 for your SFN-5122. But that sometimes doesn't happen, or the NIC doesn't play well with autonegotiation. So try setting the slots at GEN 2 or even GEN 1, if they are currently at AUTO or Gen 3.

Good Luck! I've found Solarflare to be rock solid once they were up and running, but a bit of a challenge sometimes to set up.

 

[Shenko]

Thank you Markess for your detailed suggestions, I went through all the options you mentioned, some were a little different in my bios but either way, I believe I covered all the point raised. At no point have I seen a rom bios message from any of the cards. I find it hard to believe that I managed to purchase 4 cards that are all faulty. I'm therefore tempted to try again and cut my losses but before I jump ship I was wondering if anyone had any experience with these cards :- SF329-9021-R5 I can't seem to find this specific model on solarflare's support or locate drivers, or if anyone can give me some advice on a couple of cheap 10gb cards that will work out of the box in both Linux and Windows.

Thanks again I was hopeful that your suggestions might have been successful but it seems I'm just extremely unlucky and a little lighter in the pocket.

Tia
M

 

[Markess]

If you want to keep trying on these, maybe post front & back pictures? There's a lot of OEM branded adapters out there from Dell, HP, etc. that have minor visual differences (heatsinks, etc) that a member here might recognize. That's how I was able to identify one of my Solarflare adapters in the past.

If it’s OEM, there may be some trick documented online about getting them to work with a non-OEM PC. A long shot, but you already have them in hand.

I'm no help in the buying department. I've not bought any 10G gear in over a year. But I will say that inexpensive often means older. And older, at least for Windows or VMware or etc., potentially means less driver support.

 

[Shenko]

Hi markees, I've seen a couple of these for sale on ebay they are listed as SF329-9021-R5, unfortunately, I only have a front side picture. To be honest they look exactly the same as the SFN5122F but maybe all solarflare cards look the same. Sorry, I misread your post, I will upload a couple of pictures now.

Thanks
M

 

[Shenko]

Here are some images of the sfn5122f cards, I removed the heatsink so I could get a close look at what chip was being used.

Thanks

 

[Shenko]

Just realized that the pcb revision on the sfn5122f is the same as the ones I've looked at on ebay but the ones on ebay are revision 5. whereas the ones I currently have are pcb revision 6.

 

[cesmith9999]

here you go. these are the pins that you may need to cover.

Yannick's Tech Blog: Modding a Dell Perc 6 / Dell H310 / Dell H710 (other LSI 1078 or 9223-8i based) SAS Raidcontroller

Chris

 

[Markess]

Hi markees, I've seen a couple of these for sale on ebay they are listed as SF329-9021-R5, unfortunately, I only have a front side picture. To be honest they look exactly the same as the SFN5122F but maybe all solarflare cards look the same. Sorry, I misread your post, I will upload a couple of pictures now.

Thanks
M

They don't always look alike. I learned that Dell at least put different heatsinks on some of their cards, so they don't look like the "stock" ones. A while back I thought I was buying another SFN6xxx card and it turned out the be a Dell OEM 8522. Didn't say Dell on it anywhere, but a forum member knew it by sight. Members here know all kinds of cool stuff.

If you do look for more Solarflare, a trick I learned here on the forum is that many resellers on Ebay list the PCB/Card family/some sort of stock #, and not the actual Card Model Number: SF329 should be a Series 6 Card (SFN6xxx) and SF432 are series 7 (SFN7xxx). But I understand its harder to know the exact model number when all you have is one of these codes to go by. For general use though, I believe the family is more important than the model number. In many cases the only difference between models is any extra feature license keys included in firmware. The member that posted this info said that sometimes you can get some great deals using these alternative searches because the reseller doesn't know exactly what they have.

Obviously, Series 6 & 7 are newer than series 5, so maybe they have more extensive driver support. I've got Series 7 & 8 cards and they seem to be plug and play for Linux (Ubuntu 18.04), but I've only had Mellanox ConnectX 2 & 3 in the Windows machines.

Edit: Many (all?) Solarflare Series 6 have the same SFC9020 silicon as the controller you have now. So, maybe Series 6 won't work any better for you?

 

[Shenko]

here you go. these are the pins that you may need to cover.

Yannick's Tech Blog: Modding a Dell Perc 6 / Dell H310 / Dell H710 (other LSI 1078 or 9223-8i based) SAS Raidcontroller

Chris

I tried your suggestion to no avail but thanks anyway,
I've ordered 2 SF329-9021-R5 so I will try them when they arrive and report back.

 

[altmind]

the market is flooded with solarflare 7120 for cheap, you can try them instead.

check the heatsink temps occasionally. many of solarflare cards require active cooling, but carry no fan. they can go up to 100C even when idle.

 

[BeTeP]

quoting myself from https://forums.servethehome.com/index.php?threads/solarflare-5122-vs-6122.23940

SF329-9021-R7 and newer with white aluminum heatsink is SFN6122. SF329-9021-R6 and older with black heatsink is SFN5122.

 

[Shenko]

Thank you all for your support in regards to this issue, I have purchased 2 x SF329-9021-R5 Thanks BeTep for confirming the model number. SFN5122F. spot on.
Picked up a Cisco SFP-H10GB-CU3M SFP+ 37-0961-03 10GB
Installed the cards ( still don't see any boot rom but apparently it can be turned on and off in the solarflare software )

Both Linux and windows picked up the devices both lspci /Device manager list the devices correctly ( I already had the software/drivers/modules installed on both machines ) Set up a ram disk on both machines / smb mounts. and tested speeds and they are in line with what I expected to see. Ps forgot to mention I upgraded the firmware on both cards to the latest version as they were on an older version which was super simple and built into the software which was great, no hunting around and no bricking worries.
I also forgot to mention that the software from solarflare and drivers seem to run without any problems in windows 10.

Thank you to altmind,Markess,cesmith9999, for your support I really appreciate it.