ESXi VT-d PCIe passthrough of a Intel X520 NIC

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Kristian

Active Member
Jun 1, 2013
347
84
28
Hello guys,

I have my first board with VT-d support and I am experimenting with PCIe passthrough.
While passing through several HBAs was really easy and worked out of the box,

passing through my 10GBe NIC (Intel X520) seems to "work" (shown in the freenas shell) but I can't get it to connect to the LAN (neither with dhcp, nor fixed ip)

Any ideas where I could look?
 

Kristian

Active Member
Jun 1, 2013
347
84
28
slowly please :) ssh into the freenas? Didn't try. Will do so in about 2h times and report back
 

Kristian

Active Member
Jun 1, 2013
347
84
28
@gigatexal

dmesg part 1
Code:
[root@freenas] ~# dmesg
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
  The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.3-RELEASE-p25 #0 r281084+d3a5bf7: Wed Sep  2 15:00:10 PDT 2015
  root@build3.ixsystems.com:/tank/home/jkh/build/FN/objs/os-base/amd64/tank/home/jkh/build/FN/FreeBSD/src/sys/FREENAS.amd64 amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz (3100.02-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x306a9  Family = 0x6  Model = 0x3a  Stepping = 9
  Features=0xfabfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,MMX,FXSR,SSE,SSE2,SS>
  Features2=0xfdba2203<SSE3,PCLMULQDQ,SSSE3,CX16,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Standard Extended Features=0x202<TSCADJ,ENHMOVSB>
  TSC: P-state invariant
real memory  = 13958643712 (13312 MB)
avail memory = 12365967360 (11793 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <PTLTD  APIC  >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 4 package(s) x 1 core(s)
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  2
cpu2 (AP): APIC ID:  4
cpu3 (AP): APIC ID:  6
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-23 on motherboard
ispfw: registered firmware <isp_1040>
ispfw: registered firmware <isp_1040_it>
ispfw: registered firmware <isp_1080>
ispfw: registered firmware <isp_1080_it>
ispfw: registered firmware <isp_12160>
ispfw: registered firmware <isp_12160_it>
ispfw: registered firmware <isp_2100>
ispfw: registered firmware <isp_2200>
ispfw: registered firmware <isp_2300>
ispfw: registered firmware <isp_2322>
ispfw: registered firmware <isp_2400>
ispfw: registered firmware <isp_2400_multi>
ispfw: registered firmware <isp_2500>
ispfw: registered firmware <isp_2500_multi>
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
aesni0: No AESNI support.
padlock0: No ACE support.
acpi0: <INTEL 440BX> on motherboard
acpi0: Power Button (fixed)
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 450
Event timer "HPET2" frequency 14318180 Hz quality 450
Event timer "HPET3" frequency 14318180 Hz quality 450
Event timer "HPET4" frequency 14318180 Hz quality 450
Event timer "HPET5" frequency 14318180 Hz quality 450
Event timer "HPET6" frequency 14318180 Hz quality 450
Event timer "HPET7" frequency 14318180 Hz quality 450
Event timer "HPET8" frequency 14318180 Hz quality 450
Event timer "HPET9" frequency 14318180 Hz quality 450
Event timer "HPET10" frequency 14318180 Hz quality 450
Event timer "HPET11" frequency 14318180 Hz quality 450
Event timer "HPET12" frequency 14318180 Hz quality 450
Event timer "HPET13" frequency 14318180 Hz quality 450
Event timer "HPET14" frequency 14318180 Hz quality 450
Event timer "HPET15" frequency 14318180 Hz quality 450
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel PIIX4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1060-0x106f at device 7.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
pci0: <bridge> at device 7.3 (no driver attached)
vgapci0: <VGA-compatible display> port 0x1070-0x107f mem 0xe8000000-0xefffffff,0xfe000000-0xfe7fffff irq 16 at device 15.0 on pci0
vgapci0: Boot video device
mpt0: <LSILogic 1030 Ultra4 Adapter> port 0x1400-0x14ff mem 0xfeba0000-0xfebbffff,0xfebc0000-0xfebdffff irq 17 at device 16.0 on pci0
mpt0: MPI Version=1.2.0.0
pcib2: <ACPI PCI-PCI bridge> at device 17.0 on pci0
pci2: <ACPI PCI bus> on pcib2
em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.6> port 0x2000-0x203f mem 0xfd5c0000-0xfd5dffff,0xfdff0000-0xfdffffff irq 18 at device 0.0 on pci2
em0: Ethernet address: 00:0c:29:71:e3:38
pcib3: <ACPI PCI-PCI bridge> at device 21.0 on pci0
pci3: <ACPI PCI bus> on pcib3
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.15> port 0x4000-0x401f mem 0xe7a00000-0xe7a7ffff,0xe7afc000-0xe7afffff irq 18 at device 0.0 on pci3
ix0: Using an MSI interrupt
ix0: Ethernet address: 90:e2:ba:33:a4:f4
ix0: PCI Express Bus: Speed 5.0GT/s Unknown
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.15> port 0x4020-0x403f mem 0xe7980000-0xe79fffff,0xe7af8000-0xe7afbfff irq 19 at device 0.1 on pci3
ix1: Using an MSI interrupt
ix1: Ethernet address: 90:e2:ba:33:a4:f5
ix1: PCI Express Bus: Speed 5.0GT/s Unknown
pcib4: <ACPI PCI-PCI bridge> at device 21.1 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 21.2 on pci0
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 21.3 on pci0
pci6: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> at device 21.4 on pci0
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 21.5 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 21.6 on pci0
pci9: <ACPI PCI bus> on pcib9
pcib10: <ACPI PCI-PCI bridge> at device 21.7 on pci0
pci10: <ACPI PCI bus> on pcib10
pcib11: <ACPI PCI-PCI bridge> at device 22.0 on pci0
pci11: <ACPI PCI bus> on pcib11
pcib12: <ACPI PCI-PCI bridge> at device 22.1 on pci0
pci12: <ACPI PCI bus> on pcib12
pcib13: <ACPI PCI-PCI bridge> at device 22.2 on pci0
pci13: <ACPI PCI bus> on pcib13
pcib14: <ACPI PCI-PCI bridge> at device 22.3 on pci0
pci14: <ACPI PCI bus> on pcib14
pcib15: <ACPI PCI-PCI bridge> at device 22.4 on pci0
pci15: <ACPI PCI bus> on pcib15
pcib16: <ACPI PCI-PCI bridge> at device 22.5 on pci0
pci16: <ACPI PCI bus> on pcib16
pcib17: <ACPI PCI-PCI bridge> at device 22.6 on pci0
pci17: <ACPI PCI bus> on pcib17
pcib18: <ACPI PCI-PCI bridge> at device 22.7 on pci0
pci18: <ACPI PCI bus> on pcib18
pcib19: <ACPI PCI-PCI bridge> at device 23.0 on pci0
pci19: <ACPI PCI bus> on pcib19
mps0: <Avago Technologies (LSI) SAS2008> port 0x6000-0x60ff mem 0xfd3fc000-0xfd3fffff,0xfd380000-0xfd3bffff irq 16 at device 0.0 on pci19
mps0: Firmware: 20.00.04.00, Driver: 20.00.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib20: <ACPI PCI-PCI bridge> at device 23.1 on pci0
pci20: <ACPI PCI bus> on pcib20
pcib21: <ACPI PCI-PCI bridge> at device 23.2 on pci0
pci21: <ACPI PCI bus> on pcib21
pcib22: <ACPI PCI-PCI bridge> at device 23.3 on pci0
pci22: <ACPI PCI bus> on pcib22
pcib23: <ACPI PCI-PCI bridge> at device 23.4 on pci0
pci23: <ACPI PCI bus> on pcib23
pcib24: <ACPI PCI-PCI bridge> at device 23.5 on pci0
pci24: <ACPI PCI bus> on pcib24
pcib25: <ACPI PCI-PCI bridge> at device 23.6 on pci0
pci25: <ACPI PCI bus> on pcib25
pcib26: <ACPI PCI-PCI bridge> at device 23.7 on pci0
pci26: <ACPI PCI bus> on pcib26
pcib27: <ACPI PCI-PCI bridge> at device 24.0 on pci0
pci27: <ACPI PCI bus> on pcib27
pcib28: <ACPI PCI-PCI bridge> at device 24.1 on pci0
pci28: <ACPI PCI bus> on pcib28
pcib29: <ACPI PCI-PCI bridge> at device 24.2 on pci0
pci29: <ACPI PCI bus> on pcib29
pcib30: <ACPI PCI-PCI bridge> at device 24.3 on pci0
pci30: <ACPI PCI bus> on pcib30
pcib31: <ACPI PCI-PCI bridge> at device 24.4 on pci0
pci31: <ACPI PCI bus> on pcib31
pcib32: <ACPI PCI-PCI bridge> at device 24.5 on pci0
pci32: <ACPI PCI bus> on pcib32
pcib33: <ACPI PCI-PCI bridge> at device 24.6 on pci0
pci33: <ACPI PCI bus> on pcib33
pcib34: <ACPI PCI-PCI bridge> at device 24.7 on pci0
pci34: <ACPI PCI bus> on pcib34
acpi_acad0: <AC Adapter> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse, device ID 3
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc9fff,0xca000-0xcafff,0xdc000-0xdffff,0xe0000-0xe7fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
wbwd0: HEFRAS and EFER do not align: EFER 0x2e DevID 0x08 DevRev 0x00 CR26 0x4f
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
coretemp0: Tj(target) value 0 does not seem right.
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
coretemp1: Tj(target) value 0 does not seem right.
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
coretemp2: Tj(target) value 0 does not seem right.
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
coretemp3: Tj(target) value 0 does not seem right.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
 

Kristian

Active Member
Jun 1, 2013
347
84
28
dmesg part 2
Code:
mps0: SAS Address for SATA device = 243c817ea38b9ba1
mps0: SAS Address for SATA device = 4962424cdc93bd6f
mps0: SAS Address for SATA device = 49806461fd94d595
mps0: SAS Address for SATA device = 4984546bf293ca83
mps0: SAS Address for SATA device = 4962434dde92bc70
mps0: SAS Address for SATA device = 497a6a58eda9d173
mps0: SAS Address from SATA device = 243c817ea38b9ba1
mps0: SAS Address from SATA device = 4962424cdc93bd6f
mps0: SAS Address from SATA device = 49806461fd94d595
mps0: SAS Address from SATA device = 4984546bf293ca83
mps0: SAS Address from SATA device = 4962434dde92bc70
mps0: SAS Address from SATA device = 497a6a58eda9d173
mps0: SAS Address for SATA device = 85984a1ec6ccab8f
mps0: SAS Address for SATA device = 49624648db92b771
mps0: SAS Address for SATA device = 243c8090a087809c
mps0: SAS Address for SATA device = 49846768dab8c88d
mps0: SAS Address for SATA device = 243b7e8aac91889b
mps0: SAS Address for SATA device = 243b7e8b8899829b
mps0: SAS Address from SATA device = 85984a1ec6ccab8f
mps0: SAS Address from SATA device = 49624648db92b771
mps0: SAS Address from SATA device = 243c8090a087809c
mps0: SAS Address from SATA device = 49846768dab8c88d
mps0: SAS Address from SATA device = 243b7e8aac91889b
mps0: SAS Address from SATA device = 243b7e8b8899829b
cd0 at ata1 bus 0 scbus1 target 0 lun 0
cd0: <NECVMWar VMware IDE CDR10 1.00> Removable CD-ROM SCSI-0 device
cd0: Serial Number 10000000000000000001
cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
cd0: quirks=0x40<RETRY_BUSY>
da0 at mpt0 bus 0 scbus2 target 0 lun 0
da0: <VMware Virtual disk 1.0> Fixed Direct Access SCSI-2 device
da0: 320.000MB/s transfers (160.000MHz DT, offset 127, 16bit)
da0: Command Queueing enabled
da0: 8192MB (16777216 512 byte sectors: 255H 63S/T 1044C)
da0: quirks=0x40<RETRY_BUSY>
da1 at mps0 bus 0 scbus3 target 8 lun 0
da1: <ATA WDC WD40EFRX-68W 0A80> Fixed Direct Access SCSI-6 device
da1: Serial Number  WD-WCC4ERCVK5CF
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da1: quirks=0x8<4K>
da3 at mps0 bus 0 scbus3 target 10 lun 0
da3: <ATA WDC WD40EFRX-68W 0A80> Fixed Direct Access SCSI-6 device
da3: Serial Number  WD-WCC4E0287453
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da3: quirks=0x8<4K>
da4 at mps0 bus 0 scbus3 target 11 lun 0
da4: <ATA WDC WD40EFRX-68W 0A80> Fixed Direct Access SCSI-6 device
da4: Serial Number  WD-WCC4E0175562
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da4: quirks=0x8<4K>
da5 at mps0 bus 0 scbus3 target 12 lun 0
da5: <ATA WDC WD40EFRX-68W 0A80> Fixed Direct Access SCSI-6 device
da5: Serial Number  WD-WCC4EHYCFKJ6
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da5: quirks=0x8<4K>
da6 at mps0 bus 0 scbus3 target 13 lun 0
da6: <ATA WDC WD40EFRX-68W 0A80> Fixed Direct Access SCSI-6 device
da6: Serial Number  WD-WCC4ENSLV6NX
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da6: quirks=0x8<4K>
da7 at mps0 bus 0 scbus3 target 14 lun 0
da7: <ATA WDC WD40EFRX-68W 0A82> Fixed Direct Access SCSI-6 device
da7: Serial Number  WD-WCC4ERVS3ZAP
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da7: quirks=0x8<4K>
da9 at mps0 bus 0 scbus3 target 16 lun 0
da9: <ATA WDC WD40EFRX-68W 0A80> Fixed Direct Access SCSI-6 device
da9: Serial Number  WD-WCC4E0534404
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da9: quirks=0x8<4K>
da10 at mps0 bus 0 scbus3 target 51 lun 0
da10: <ATA WDC WD4000FYYZ-0 1K03> Fixed Direct Access SCSI-6 device
da10: Serial Number  WD-WMC130D0WU2S
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da2 at mps0 bus 0 scbus3 target 9 lun 0
da2: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SCSI-6 device
da2: Serial Number  PK1334PCK8NHLX
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da8 at mps0 bus 0 scbus3 target 15 lun 0
da8: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SCSI-6 device
da8: Serial Number  PK2334PBHDVN9R
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da11 at mps0 bus 0 scbus3 target 53 lun 0
da11: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SCSI-6 device
da11: Serial Number  PK1334PCJJKD1S
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
da12 at mps0 bus 0 scbus3 target 54 lun 0
da12: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SCSI-6 device
da12: Serial Number  PK2334PBHE2V3R
da12: 600.000MB/s transfers
da12: Command Queueing enabled
da12: 3815447MB (7814037168 512 byte sectors: 255H 63S/T 486401C)
ses0 at mps0 bus 0 scbus3 target 18 lun 0
ses0: <LSI SAS3x40 0601> Fixed Enclosure Services SCSI-5 device
ses0: Serial Number
ses0: 600.000MB/s transfers
ses0: Command Queueing enabled
ses0: SCSI-3 ENC Device
ses0: da2,pass3: Element descriptor: 'Slot01'
ses0: da2,pass3: SAS Device Slot Element: 1 Phys at Slot 1
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b51681
ses0: da4,pass5: Element descriptor: 'Slot03'
ses0: da4,pass5: SAS Device Slot Element: 1 Phys at Slot 3
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b51683
ses0: da6,pass7: Element descriptor: 'Slot05'
ses0: da6,pass7: SAS Device Slot Element: 1 Phys at Slot 5
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b51685
ses0: da1,pass2: Element descriptor: 'Slot06'
ses0: da1,pass2: SAS Device Slot Element: 1 Phys at Slot 6
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b51686
ses0: da3,pass4: Element descriptor: 'Slot08'
ses0: da3,pass4: SAS Device Slot Element: 1 Phys at Slot 8
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b51688
ses0: da5,pass6: Element descriptor: 'Slot10'
ses0: da5,pass6: SAS Device Slot Element: 1 Phys at Slot 10
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b5168a
ses0: da10,pass12: Element descriptor: 'Slot13'
ses0: da10,pass12: SAS Device Slot Element: 1 Phys at Slot 13
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b5169d
ses0: da9,pass10: Element descriptor: 'Slot15'
ses0: da9,pass10: SAS Device Slot Element: 1 Phys at Slot 15
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b5169f
ses0: da11,pass13: Element descriptor: 'Slot17'
ses0: da11,pass13: SAS Device Slot Element: 1 Phys at Slot 17
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b516a1
ses0: da7,pass8: Element descriptor: 'Slot18'
ses0: da7,pass8: SAS Device Slot Element: 1 Phys at Slot 18
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b516a2
ses0: da8,pass9: Element descriptor: 'Slot20'
ses0: da8,pass9: SAS Device Slot Element: 1 Phys at Slot 20
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b516a4
ses0: da12,pass14: Element descriptor: 'Slot22'
ses0: da12,pass14: SAS Device Slot Element: 1 Phys at Slot 22
ses0:  phy 0: SATA device
ses0:  phy 0: parent 5003048001b516bf addr 5003048001b516a6
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
Timecounter "TSC-low" frequency 1550011000 Hz quality 1000
Trying to mount root from zfs:freenas-boot/ROOT/default []...
GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
VMware memory control driver initialized
wbwd0: HEFRAS and EFER do not align: EFER 0x2e DevID 0x08 DevRev 0x00 CR26 0x4f
vboxdrv: fAsync=0 offMin=0x33d offMax=0x438f
 

Kristian

Active Member
Jun 1, 2013
347
84
28
ifconfig
Code:
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
  options=9b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM>
  ether 00:0c:29:71:e3:38
  inet 192.168.178.48 netmask 0xffffff00 broadcast 192.168.178.255
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect (1000baseT <full-duplex>)
  status: active
ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
  options=407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSU  M,TSO4,TSO6,LRO,VLAN_HWTSO>
  ether 90:e2:ba:33:a4:f4
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect
  status: no carrier
ix1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
  options=407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSU  M,TSO4,TSO6,LRO,VLAN_HWTSO>
  ether 90:e2:ba:33:a4:f5
  nd6 options=9<PERFORMNUD,IFDISABLED>
  media: Ethernet autoselect
  status: no carrier
ipfw0: flags=8801<UP,SIMPLEX,MULTICAST> metric 0 mtu 65536
  nd6 options=9<PERFORMNUD,IFDISABLED>
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
  options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
  inet6 ::1 prefixlen 128
  inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
  inet 127.0.0.1 netmask 0xff000000
  nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
 

ljvb

Member
Nov 8, 2015
97
32
18
47
The no carrier is your problem. Since the card is showing up, passthrough is working. You are most likely having a problem with the cabling, or switch route.

On the switch, try setting the port to 10GB full duplex from autoselect and see if you get a link. If not, try forcing 1GB full duplex.
 

Kristian

Active Member
Jun 1, 2013
347
84
28
Setting the speed to 10GB full duplex solved the problem :)
Thank you very much!

Strange solution I must say. If I run FreeNAS on bare metal it works without the need to change settings in the switch gui.
And newbie that I am I was expecting a NIC that is"pass(ed)-through" like a bare metal nic would do.