Well I am quite happy to post this update. My Topton box with the 1240P processor and 10G SFP+ ports arrived today.
TLDR: The device can push 20 Gbps (10 in and 10 out) with packet inspection enabled.
My setup: - two PCs, both with 82599 (X520) cards connected by fiber to the topton running pfSense 2.7.2
bare metal. The WAN interface is one of the 2.5 G ports.
The PCI speeds show for ix0 and ix1 as follows with pciconf:
Code:
> pciconf -lcv ix0
ix0@pci0:4:0:0: class=0x020000 rev=0x01 hdr=0x00 vendor=0x8086 device=0x10fb subvendor=0xffff subdevice=0xffff
vendor = 'Intel Corporation'
device = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
class = network
subclass = ethernet
cap 01[40] = powerspec 3 supports D0 D3 current D0
cap 05[50] = MSI supports 1 message, 64 bit, vector masks
cap 11[70] = MSI-X supports 64 messages, enabled
Table in map 0x20[0x0], PBA in map 0x20[0x2000]
cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS
max read 512
link x4(x8) speed 5.0(5.0) ASPM disabled(L0s)
cap 03[e0] = VPD
ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
ecap 0003[140] = Serial 1 d42000ffffb1d8b3
ecap 000e[150] = ARI 1
ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI disabled
0 VFs configured out of 64 supported
First VF RID Offset 0x0180, VF RID Stride 0x0002
VF Device ID 0x10ed
Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576, 4194304
> pciconf -lcv ix1
ix1@pci0:4:0:1: class=0x020000 rev=0x01 hdr=0x00 vendor=0x8086 device=0x10fb subvendor=0xffff subdevice=0xffff
vendor = 'Intel Corporation'
device = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
class = network
subclass = ethernet
cap 01[40] = powerspec 3 supports D0 D3 current D0
cap 05[50] = MSI supports 1 message, 64 bit, vector masks
cap 11[70] = MSI-X supports 64 messages, enabled
Table in map 0x20[0x0], PBA in map 0x20[0x2000]
cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS
max read 512
link x4(x8) speed 5.0(5.0) ASPM disabled(L0s)
cap 03[e0] = VPD
ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
ecap 0003[140] = Serial 1 d42000ffffb1d8b3
ecap 000e[150] = ARI 1
ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI disabled
0 VFs configured out of 64 supported
First VF RID Offset 0x0180, VF RID Stride 0x0002
VF Device ID 0x10ed
Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576, 4194304
So they both report x4 lanes of PCIe 2.0 bandwidth available to each.
iperf3 shows this directly to the firewall (I used 10 threads: -P 10):
Code:
[SUM] 0.00-10.00 sec 11.0 GBytes 9.43 Gbits/sec sender
[SUM] 0.00-10.00 sec 11.0 GBytes 9.43 Gbits/sec receiver
iperf3 shows this between PC1 and PC2 (routed through the firewall, and inspected by Suricata - Suricata is detecting things so I know its inspecting)
Code:
[SUM] 0.00-90.59 sec 100 GBytes 9.48 Gbits/sec sender
[SUM] 0.00-90.59 sec 100 GBytes 9.48 Gbits/sec receiver
And the pfSense Traffic graphs look like this:
I will include this in my eventual review on the Ali-Express page so that other folks will know. So that is that! Very happy with these results. On the weekend I will try virtualizing pfSense on top of Proxmox and see how that goes.
P.S. I used these SFP+ modules coded for intel and they just worked with 10Gtek Fiber Patch Cables (LC to LC OM3)