MiniKnight

How-to Guide Install Mellanox Driver Proxmox VE 5.1

More involved

  1. MiniKnight

    MiniKnight Well-Known Member

    Joined:
    Mar 30, 2012
    Messages:
    2,941
    Likes Received:
    857
    MiniKnight submitted a new resource:

    Install Mellanox Driver Proxmox VE 5.1 - More involved

    Read more about this resource...
     
    #1
    jak, _alex, Marsh and 4 others like this.
  2. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,543
    Likes Received:
    4,467
    Nice writeup.
     
    #2
  3. K D

    K D Well-Known Member

    Joined:
    Dec 24, 2016
    Messages:
    1,404
    Likes Received:
    297
    Thank you.
     
    #3
  4. Patrick

    Patrick Administrator
    Staff Member

    Joined:
    Dec 21, 2010
    Messages:
    11,543
    Likes Received:
    4,467
    Hey @MiniKnight

    I just tried this and did have to do the .deb install. I also had an error:
    Code:
    Error: The current mlnx-en is intended for debian9.0
    
    So I fixed that and updated your guide with:
    Code:
    ./install --skip-distro-check 
     
    #4
  5. ideabox

    ideabox Member

    Joined:
    Dec 11, 2016
    Messages:
    69
    Likes Received:
    25
    Is Ubuntu not the underlying kernel??? I thought it was
     
    #5
  6. PigLover

    PigLover Moderator

    Joined:
    Jan 26, 2011
    Messages:
    2,771
    Likes Received:
    1,114
    The Proxmox kernel is a custom build of the upstream kernel, for Proxmox 5.1 currently based on 4.13-4. The Proxmox 5.1 user level libraries are Debian 9.0. The flag Patrick noted has to be set is because the kernel does not identify itself as Debian.
     
    #6
    ideabox likes this.
  7. _alex

    _alex Active Member

    Joined:
    Jan 28, 2016
    Messages:
    874
    Likes Received:
    94
    Nice.
    Is this a working dkms-install ?

    The last time i tried to install ofed it ran badly into some dependency mismatch. The result were either removed pve-packages or the installer stuck in a loop while checking deps. So i stayed with the in-tree tools and modules, what also works.
     
    #7
  8. ideabox

    ideabox Member

    Joined:
    Dec 11, 2016
    Messages:
    69
    Likes Received:
    25
    Getting an error trying this:

    # lsb_release is required to continue
    # Current operation system is not supported!

    Any ideas?
     
    #8
  9. cluefr

    cluefr New Member

    Joined:
    Feb 11, 2018
    Messages:
    10
    Likes Received:
    2
    apt-get install lsb-release

    my issue when all is fixed is a loop in proxmox package need, i just install all package and work fine even after kernel upgrade
     
    #9
  10. ZeroQool

    ZeroQool New Member

    Joined:
    Nov 17, 2018
    Messages:
    1
    Likes Received:
    0
    Code:
    root@proxmox:~/mlnx-en-4.2-1.0.1.0-debian9.0-x86_64# ./install --skip-distro-check
    Logs dir: /tmp/mlnx-en.17630.logs
    General log file: /tmp/mlnx-en.17630.logs/general.log
    
    Below is the list of mlnx-en packages that you have chosen
    (some may have been added by the installer due to package dependencies):
    
    ofed-scripts
    mlnx-en-utils
    mlnx-en-dkms
    mstflint
    
    This program will install the mlnx-en package on your machine.
    Note that all other Mellanox, OEM, OFED, RDMA or Distribution IB packages will be removed.
    Those packages are removed due to conflicts with mlnx-en, do not reinstall them.
    
    Do you want to continue?[y/N]:y
    
    Checking SW Requirements...
    Removing old packages...
    Uninstalling the previous version of mlnx-en
    
    
    Hang up after this line "Uninstalling the previous version of mlnx-en". I dont know what I can do?
     
    #10
  11. lowfat

    lowfat Member

    Joined:
    Nov 25, 2016
    Messages:
    77
    Likes Received:
    58
    Similar issue. Mine just hangs @ 'Removing old packages...'

    Code:
    
    root@pve:/zfsraid/media/temp/MLNX_OFED_LINUX-4.5-1.0.1.0-debian9.5-x86_64# ./mlnxofedinstall --skip-distro-check --add-kernel-support
    Note: This program will create MLNX_OFED_LINUX TGZ for debian9.6 under /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.15.18-9-pve directory.
    See log file /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.15.18-9-pve/mlnx_iso.2312_logs/mlnx_ofed_iso.2312.log
    
    WARNING: The current MLNX_OFED_LINUX is intended for debian9.5 !
    You may need to use the '--skip-distro-check' flag to install the resulting MLNX_OFED_LINUX on this system.
    
    Checking if all needed packages are installed...
    Building MLNX_OFED_LINUX DEBS . Please wait...
    Creating metadata-rpms for 4.15.18-9-pve ...
    WARNING: If you are going to configure this package as a repository, then please note
    WARNING: that it is not signed, therefore, you need to set 'trusted=yes' in the sources.list file.
    WARNING: Example: deb [trusted=yes] file:/<path to MLNX_OFED DEBS folder> ./
    Created /tmp/MLNX_OFED_LINUX-4.5-1.0.1.0-4.15.18-9-pve/MLNX_OFED_LINUX-4.5-1.0.1.0-debian9.6-ext.tgz
    Removing old packages...
    
     
    #11
  12. cluefr

    cluefr New Member

    Joined:
    Feb 11, 2018
    Messages:
    10
    Likes Received:
    2
    @lowfat @ZeroQool
    Here is a work around

    Run one time as you did and when it's hang on "Removing old packages" (code is looping, check dpkg.log for check if loop happen), stop the install script.

    vi the install script (mlnxofedinstall) and search for remove_old_packages function.
    Then edit it like this :

    Code:
    #
    # remove old packages
    #
    sub remove_old_packages
    {
    return;
    Run again and it's will work fine
     
    #12
    lowfat likes this.
  13. am45931472

    am45931472 Member

    Joined:
    Feb 26, 2019
    Messages:
    40
    Likes Received:
    7
    ok. what am i missing. the following wget isnt a web location


    wget quilt python-libxml2 swig dpatch graphviz chrpath
     
    #13
  14. MiniKnight

    MiniKnight Well-Known Member

    Joined:
    Mar 30, 2012
    Messages:
    2,941
    Likes Received:
    857
    @am45931472

    That wget line is part of the apt-get line above it
     
    #14
  15. am45931472

    am45931472 Member

    Joined:
    Feb 26, 2019
    Messages:
    40
    Likes Received:
    7

    Thanks for the responce. However I get the following missing packages error, even when i try to run the whole code together

    apt-get -y install debhelper autotools-dev dkms zlib1g-dev python
    wget quilt python-libxml2 swig dpatch graphviz chrpath

    root@pve:~# wget quilt python-libxml2 swig dpatch graphviz chrpath
    --2019-05-21 17:05:12-- http://quilt/
    Resolving quilt (quilt)... failed: Name or service not known.
    wget: unable to resolve host address ‘quilt’
    --2019-05-21 17:05:12-- http://python-libxml2/
    Resolving python-libxml2 (python-libxml2)... failed: Name or service not known.
    wget: unable to resolve host address ‘python-libxml2’
    --2019-05-21 17:05:12-- http://swig/
    Resolving swig (swig)... failed: Name or service not known.
    wget: unable to resolve host address ‘swig’
    --2019-05-21 17:05:12-- http://dpatch/
    Resolving dpatch (dpatch)... failed: Name or service not known.
    wget: unable to resolve host address ‘dpatch’
    --2019-05-21 17:05:12-- http://graphviz/
    Resolving graphviz (graphviz)... failed: Name or service not known.
    wget: unable to resolve host address ‘graphviz’
    --2019-05-21 17:05:12-- http://chrpath/
    Resolving chrpath (chrpath)... failed: Name or service not known.
    wget: unable to resolve host address ‘chrpath’


    on install

    One or more required packages for installing mlnx-en are missing.
    /lib/modules/4.15.18-12-pve/build/scripts is required for the Installation.
    Attempting to install the following missing packages:
    graphviz dpatch python-libxml2 quilt linux-headers-4.15.18-12-pve chrpath swig
    Failed command: apt-get install -y graphviz dpatch python-libxml2 quilt linux-headers-4.15.18-12-pve chrpath swig


    This is on PVE 5.4.3 in a virtual machine. throught I would try this in a VM first before bare metal.

    I am passing through the Connectx 3 VPI to the VM which is seen as a PCI device by the bare metal system but not as an interface.
     
    #15
  16. MiniKnight

    MiniKnight Well-Known Member

    Joined:
    Mar 30, 2012
    Messages:
    2,941
    Likes Received:
    857
    @am45931472 on the first part, let me make this easier for you since you're not executing it all on one line:
    Code:
    apt -y install wget quilt python-libxml2 swig dpatch graphviz chrpath
    On the second part, you'll notice that you're missing headers. The extra step in my guide will see how to install the headers.
     
    #16
  17. jwest5637

    jwest5637 New Member

    Joined:
    Nov 1, 2019
    Messages:
    2
    Likes Received:
    0
    Hello,

    Sorry to dredge up this old thread, but I am having some troubles with the following error:

    One or more required packages for installing MLNX_OFED_LINUX are missing.
    Attempting to install the following missing packages:
    libgfortran3 libssl1.0.0
    Failed command: apt-get install -y libgfortran3 libssl1.0.0


    I believe libgfortran3 and libssl were both deprecated? But I am not sure how to proceed otherwise. :'(

    JW
     
    #17
  18. Terry Wallace

    Terry Wallace PsyOps SysOp

    Joined:
    Aug 13, 2018
    Messages:
    84
    Likes Received:
    35
    This thread is about installing on Proxmox 5-1 are you actually using this ?
    5-4 and versions after that I have used just deteced the mellanox card and they worked with no extra downloads or packages required..
    Proxmox 6-0 is current version.
     
    #18
    T_Minus likes this.
  19. fossxplorer

    fossxplorer Active Member

    Joined:
    Mar 17, 2016
    Messages:
    407
    Likes Received:
    44
    Does SR-IOV work without installing MLX_OFED drivers from Mellanox?
    IIRC, on CentOS 7, it was something with SR-IOV not working with the open source drivers some years back.
     
    #19
  20. jwest5637

    jwest5637 New Member

    Joined:
    Nov 1, 2019
    Messages:
    2
    Likes Received:
    0
    Woops, my apologies, I spent several hours in "debug hell" before making my way here, so you're right, I am off thread a bit.

    I am using Proxmox 6.0, and more of my issue may be related to the fact that I am trying to get a couple connectx2 working, as they're fairly old hardware...

    Could also just be that I am still learning. I am expecting to see the Mollanox cards appear in the networking section of Proxmox, is that not the case?

    --> Similarly, I found a workaround by setting their (from memory:) eth > (...pci)/mlx_port1, which has the devices appear in networking, but getting them communicating has been slow sailing. Across the Mellanox MFT (etc) I keep getting driver related errors, which is why I was following this thread's guide.
     
    #20
Similar Threads: Install Mellanox
Forum Title Date
Guides Install IPMIView 2 on Debian/ Ubuntu May 4, 2017
Guides CEPH Install work instruction (Kraken release) Feb 15, 2017
Guides Installing OpenSSL 1.1.0 on Ubuntu Sep 17, 2016
Guides GIGABYTE EL-20 Debian 8.5 Minimal Server install guide Aug 31, 2016
Guides Install Script for ixgbe on Debian/ Ubuntu Feb 10, 2016

Share This Page