I'm reading in some threads here that I can enable SR-IOV with the built-in mlx driver (as confirmed by @fohdeesha too) of the CX3 in Proxmox/Debian. So no need to install the aggressive MLNX_OFED driver from Nvidia and here's what I tried doing:
wget https://www.mellanox.com/downloads/MFT/mft-4.26.1-3-x86_64-deb.tgz
apt-get install gcc make dkms pve-headers
tar -xvzf mft-4.22.1-11-x86_64-deb.tgz
cd mft-4.22.1-11-x86_64-deb/
./install.sh
mst start
As soon as I try doing mst start, I get this:
Here's the output of lspci for reference:
wget https://www.mellanox.com/downloads/MFT/mft-4.26.1-3-x86_64-deb.tgz
apt-get install gcc make dkms pve-headers
tar -xvzf mft-4.22.1-11-x86_64-deb.tgz
cd mft-4.22.1-11-x86_64-deb/
./install.sh
mst start
As soon as I try doing mst start, I get this:
Why can it not start? Probably because of secure boot being enabled on the host? If so, can I temporarily disable it while I try enabling SR-IOV and then re-enable it back afterwards?Starting MST (Mellanox Software Tools) driver set
Loading MST PCI modulemodprobe: ERROR: could not insert 'mst_pci': Key was rejected by service
- Failure: 1
Loading MST PCI configuration modulemodprobe: ERROR: could not insert 'mst_pciconf': Key was rejected by service
- Failure: 1
Create devices
mst_pci driver not found
Unloading MST PCI module (unused) - Success
Unloading MST PCI configuration module (unused) - Success
Here's the output of lspci for reference:
02:00.0 Ethernet controller: Mellanox Technologies MT27500 Family [ConnectX-3]
Subsystem: Mellanox Technologies ConnectX-3 10 GbE Single Port SFP+ Adapter
Flags: bus master, fast devsel, latency 0, IRQ 16, IOMMU group 8
Memory at f7100000 (64-bit, non-prefetchable) [size=1M]
Memory at f2800000 (64-bit, prefetchable) [size=8M]
Expansion ROM at f7000000 [disabled] [size=1M]
Capabilities: [40] Power Management version 3
Capabilities: [48] Vital Product Data
Capabilities: [9c] MSI-X: Enable+ Count=128 Masked-
Capabilities: [60] Express Endpoint, MSI 00
Capabilities: [c0] Vendor Specific Information: Len=18 <?>
Capabilities: [100] Alternative Routing-ID Interpretation (ARI)
Capabilities: [148] Device Serial Number 24-8a-07-03-00-79-4b-e0
Capabilities: [154] Advanced Error Reporting
Capabilities: [18c] Secondary PCI Express
Kernel driver in use: mlx4_core
Kernel modules: mlx4_core
Last edited: