NetApp X2065A-R6/PMC-Sierra PM8003 doesn't work on Dell servers

[wemonkee]

I've got a few of these PM8003 cards, a rev 3.0, 3.2, and 5.0. None of them seem to play nice with dell servers - I've tried an r610 and an r820. I'm aware of issues with kernel 5.10 and above and driver 0.1.40, so the following is kernel 5.8 with driver 0.1.39, which works fine on my consumer computer.

This is an output of dmesg | grep -i pm80xx.

pm80xx 000:47:00.0:  pm80xx: driver version 0.1.39

:: pm8001_pci_alloc  496:Setting link rate to default value

scsi host0: pm80xx

pm80xx 000:48:00.0:  pm80xx: driver version 0.1.39

pm80xx 0000:47:00.0: AER: can't recover (no error_detected callback)

:: pm8001_pci_alloc  496:Setting link rate to default value

scsi host2: pm80xx

pm80xx 0000:48:00.0: AER: can't recover (no error_detected callback)

pm80xx 0000:47:00.0: AER: can't recover (no error_detected callback)

pm80xx 0000:48:00.0: AER: can't recover (no error_detected callback)

`lsscsi` shows no NetApp devices, but the pm8003 does show up in `lspci`.

My setup is a DS4243 w/ IOM3 connected with the qsfp square port to port A on the PM8003. I tried both a Dell r820 and a Dell r610 with no success. Tried RHEL 8 w/ kernel 4.18 as well as Ubuntu Server w/ kernel 5.8.

Any help is appreciated.

 

[wemonkee]

Some updates and troubleshooting. I tried FreeBSD and it works great - all the drives are detected as well as the NetApp in `camcontrol devlist`.

From this, I don't think it's a hardware issue. However, I can't seem to get it to work in Linux for the life of me though - tried RHEL 6.5 (when support for pm80xx was introduced), RHEL 7.9 (latest version supporting pm80xx), OpenSUSE tumbleweed (kernel 5.12 w/ pm80xx support), Ubuntu server 18.04/20.04 and couldn't get it to work anywhere, always that same error. Meanwhile, I tried the Rev 3.2 PM8003 in my consumer machine and it booted no problem on Ubuntu 20.04. If anyone has some experience with this card, I would be super appreciative of some tips to get it working with Linux.

 

[octogonapus]

Sorry to revive an old thread, but I just found this thread and it's quite similar to one I made the other day https://forums.servethehome.com/index.php?threads/linux-gets-fatal-pcie-error-with-hba-card.36919/

Did you ever find out how to get this card working on Linux? I have almost identical experiences to you and haven't found any solutions for Linux yet.

 

[Ergonomic4553]

Well, I'm trying to get the same thing working in Debian, but no luck yet.