MiniKnight

Install Mellanox Driver Proxmox VE 5.1

MiniKnight

Well-Known Member
Mar 30, 2012
2,987
892
113
NYC
MiniKnight submitted a new resource:

Install Mellanox Driver Proxmox VE 5.1 - More involved

This was harder than normal Debian or Ubuntu since it's not supported out of the box.

Here's what I did:
Code:
#dependencies
apt-get -y install debhelper autotools-dev dkms zlib1g-dev python
wget quilt python-libxml2 swig dpatch graphviz chrpath
#download and install
wget http://www.mellanox.com/downloads/ofed/MLNX_EN-4.2-1.0.1.0/mlnx-en-4.2-1.0.1.0-debian9.0-x86_64.tgz
tar xzvf mlnx-en-4.2-1.0.1.0-debian9.0-x86_64.tgz
cd mlnx-en-4.2-1.0.1.0-debian9.0-x86_64.tgz
./install
If you...
Read more about this resource...
 

Patrick

Administrator
Staff member
Dec 21, 2010
11,908
4,871
113
Hey @MiniKnight

I just tried this and did have to do the .deb install. I also had an error:
Code:
Error: The current mlnx-en is intended for debian9.0
So I fixed that and updated your guide with:
Code:
./install --skip-distro-check
 

PigLover

Moderator
Jan 26, 2011
2,964
1,271
113
The Proxmox kernel is a custom build of the upstream kernel, for Proxmox 5.1 currently based on 4.13-4. The Proxmox 5.1 user level libraries are Debian 9.0. The flag Patrick noted has to be set is because the kernel does not identify itself as Debian.
 
  • Like
Reactions: ideabox

_alex

Active Member
Jan 28, 2016
874
94
28
Bavaria / Germany
Nice.
Is this a working dkms-install ?

The last time i tried to install ofed it ran badly into some dependency mismatch. The result were either removed pve-packages or the installer stuck in a loop while checking deps. So i stayed with the in-tree tools and modules, what also works.
 

ideabox

Member
Dec 11, 2016
69
25
18
33
Getting an error trying this:

# lsb_release is required to continue
# Current operation system is not supported!

Any ideas?
 

cluefr

New Member
Feb 11, 2018
10
2
3
45
Getting an error trying this:

# lsb_release is required to continue
# Current operation system is not supported!

Any ideas?
apt-get install lsb-release

my issue when all is fixed is a loop in proxmox package need, i just install all package and work fine even after kernel upgrade
 

ZeroQool

New Member
Nov 17, 2018
1
0
1
Code:
root@proxmox:~/mlnx-en-4.2-1.0.1.0-debian9.0-x86_64# ./install --skip-distro-check
Logs dir: /tmp/mlnx-en.17630.logs
General log file: /tmp/mlnx-en.17630.logs/general.log

Below is the list of mlnx-en packages that you have chosen
(some may have been added by the installer due to package dependencies):

ofed-scripts
mlnx-en-utils
mlnx-en-dkms
mstflint

This program will install the mlnx-en package on your machine.
Note that all other Mellanox, OEM, OFED, RDMA or Distribution IB packages will be removed.
Those packages are removed due to conflicts with mlnx-en, do not reinstall them.

Do you want to continue?[y/N]:y

Checking SW Requirements...
Removing old packages...
Uninstalling the previous version of mlnx-en
Hang up after this line "Uninstalling the previous version of mlnx-en". I dont know what I can do?
 

lowfat

Active Member
Nov 25, 2016
102
70
28
37
Similar issue. Mine just hangs @ 'Removing old packages...'

Code:
root@pve:/zfsraid/media/temp/MLNX_OFED_LINUX-4.5-1.0.1.0-debian9.5-x86_64# ./mlnxofedinstall --skip-distro-check --add-kernel-support
Note: This program will create MLNX_OFED_LINUX TGZ for debian9.6 under /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.15.18-9-pve directory.
See log file /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.15.18-9-pve/mlnx_iso.2312_logs/mlnx_ofed_iso.2312.log

WARNING: The current MLNX_OFED_LINUX is intended for debian9.5 !
You may need to use the '--skip-distro-check' flag to install the resulting MLNX_OFED_LINUX on this system.

Checking if all needed packages are installed...
Building MLNX_OFED_LINUX DEBS . Please wait...
Creating metadata-rpms for 4.15.18-9-pve ...
WARNING: If you are going to configure this package as a repository, then please note
WARNING: that it is not signed, therefore, you need to set 'trusted=yes' in the sources.list file.
WARNING: Example: deb [trusted=yes] file:/<path to MLNX_OFED DEBS folder> ./
Created /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.15.18-9-pve/MLNX_OFED_LINUX-4.5-1.0.1.0-debian9.6-ext.tgz
Removing old packages...
 

cluefr

New Member
Feb 11, 2018
10
2
3
45
@lowfat @ZeroQool
Here is a work around

Run one time as you did and when it's hang on "Removing old packages" (code is looping, check dpkg.log for check if loop happen), stop the install script.

vi the install script (mlnxofedinstall) and search for remove_old_packages function.
Then edit it like this :

Code:
#
# remove old packages
#
sub remove_old_packages
{
return;
Run again and it's will work fine
 
  • Like
Reactions: lowfat

am45931472

Member
Feb 26, 2019
75
17
8
ok. what am i missing. the following wget isnt a web location


wget quilt python-libxml2 swig dpatch graphviz chrpath
 

am45931472

Member
Feb 26, 2019
75
17
8
@am45931472

That wget line is part of the apt-get line above it

Thanks for the responce. However I get the following missing packages error, even when i try to run the whole code together

apt-get -y install debhelper autotools-dev dkms zlib1g-dev python
wget quilt python-libxml2 swig dpatch graphviz chrpath

root@pve:~# wget quilt python-libxml2 swig dpatch graphviz chrpath
--2019-05-21 17:05:12-- http://quilt/
Resolving quilt (quilt)... failed: Name or service not known.
wget: unable to resolve host address ‘quilt’
--2019-05-21 17:05:12-- http://python-libxml2/
Resolving python-libxml2 (python-libxml2)... failed: Name or service not known.
wget: unable to resolve host address ‘python-libxml2’
--2019-05-21 17:05:12-- http://swig/
Resolving swig (swig)... failed: Name or service not known.
wget: unable to resolve host address ‘swig’
--2019-05-21 17:05:12-- http://dpatch/
Resolving dpatch (dpatch)... failed: Name or service not known.
wget: unable to resolve host address ‘dpatch’
--2019-05-21 17:05:12-- http://graphviz/
Resolving graphviz (graphviz)... failed: Name or service not known.
wget: unable to resolve host address ‘graphviz’
--2019-05-21 17:05:12-- http://chrpath/
Resolving chrpath (chrpath)... failed: Name or service not known.
wget: unable to resolve host address ‘chrpath’


on install

One or more required packages for installing mlnx-en are missing.
/lib/modules/4.15.18-12-pve/build/scripts is required for the Installation.
Attempting to install the following missing packages:
graphviz dpatch python-libxml2 quilt linux-headers-4.15.18-12-pve chrpath swig
Failed command: apt-get install -y graphviz dpatch python-libxml2 quilt linux-headers-4.15.18-12-pve chrpath swig


This is on PVE 5.4.3 in a virtual machine. throught I would try this in a VM first before bare metal.

I am passing through the Connectx 3 VPI to the VM which is seen as a PCI device by the bare metal system but not as an interface.
 

MiniKnight

Well-Known Member
Mar 30, 2012
2,987
892
113
NYC
@am45931472 on the first part, let me make this easier for you since you're not executing it all on one line:
Code:
apt -y install wget quilt python-libxml2 swig dpatch graphviz chrpath
On the second part, you'll notice that you're missing headers. The extra step in my guide will see how to install the headers.
 

jwest5637

New Member
Nov 1, 2019
2
0
1
Hello,

Sorry to dredge up this old thread, but I am having some troubles with the following error:

One or more required packages for installing MLNX_OFED_LINUX are missing.
Attempting to install the following missing packages:
libgfortran3 libssl1.0.0
Failed command: apt-get install -y libgfortran3 libssl1.0.0


I believe libgfortran3 and libssl were both deprecated? But I am not sure how to proceed otherwise. :'(

JW
 

Terry Wallace

PsyOps SysOp
Aug 13, 2018
138
78
28
51
Allen, TX
This thread is about installing on Proxmox 5-1 are you actually using this ?
5-4 and versions after that I have used just deteced the mellanox card and they worked with no extra downloads or packages required..
Proxmox 6-0 is current version.
 
  • Like
Reactions: T_Minus

fossxplorer

Active Member
Mar 17, 2016
466
74
28
Oslo, Norway
Does SR-IOV work without installing MLX_OFED drivers from Mellanox?
IIRC, on CentOS 7, it was something with SR-IOV not working with the open source drivers some years back.
 

jwest5637

New Member
Nov 1, 2019
2
0
1
Woops, my apologies, I spent several hours in "debug hell" before making my way here, so you're right, I am off thread a bit.

I am using Proxmox 6.0, and more of my issue may be related to the fact that I am trying to get a couple connectx2 working, as they're fairly old hardware...

Could also just be that I am still learning. I am expecting to see the Mollanox cards appear in the networking section of Proxmox, is that not the case?

--> Similarly, I found a workaround by setting their (from memory:) eth > (...pci)/mlx_port1, which has the devices appear in networking, but getting them communicating has been slow sailing. Across the Mellanox MFT (etc) I keep getting driver related errors, which is why I was following this thread's guide.