This is my situation:
Internet connection Fibre 750Mbps/750Mbps transceiver sticks into my computer router (pfSense).
Computer/router is 2 x Xeon X5650 with 32G of Ram. With HP 656089-001 Infiniband 10/40GB DP NIC 649281-B21 flashed to Mellanox firmware by following the thread on STH and set to eth mode.
When I install pfSense 2.4.4 on the hardware by itself and install Suricata, pfblocker and turn on lots of options, I can run multiple speedtests from ISP's and cpu runs at 35% max and it is very fluid. I get up to 800Mbps/800Mbps on multiple tests running at the same time. (I managed to figure out how to take the drivers from a VM running FreeBSD and install them into pfSense to make this work. A few great posts on STH helped with this!)
Now if I try the same thing with Proxmox/pfSense I am lucky to achieve 300/300, even with all the 24 cpu's and 32G of ram allocated just to pfSense. CPU never goes over 35% either but performance is less than half.
I was hoping that I could make the Proxmox/pfSense work with similar results so I would have some head room to spin up a VM to play with new releases of pfSense or maybe run a different DHCP server etc.
I have exhausted my reading and comprehending what to do to troubleshoot this problem so I am reaching out.
Do i need to install drivers for the Mellanox card into Proxmox? Or tweak something? Or is this just not going to work?
Thanks for looking.
Snorf
Internet connection Fibre 750Mbps/750Mbps transceiver sticks into my computer router (pfSense).
Computer/router is 2 x Xeon X5650 with 32G of Ram. With HP 656089-001 Infiniband 10/40GB DP NIC 649281-B21 flashed to Mellanox firmware by following the thread on STH and set to eth mode.
When I install pfSense 2.4.4 on the hardware by itself and install Suricata, pfblocker and turn on lots of options, I can run multiple speedtests from ISP's and cpu runs at 35% max and it is very fluid. I get up to 800Mbps/800Mbps on multiple tests running at the same time. (I managed to figure out how to take the drivers from a VM running FreeBSD and install them into pfSense to make this work. A few great posts on STH helped with this!)
Now if I try the same thing with Proxmox/pfSense I am lucky to achieve 300/300, even with all the 24 cpu's and 32G of ram allocated just to pfSense. CPU never goes over 35% either but performance is less than half.
I was hoping that I could make the Proxmox/pfSense work with similar results so I would have some head room to spin up a VM to play with new releases of pfSense or maybe run a different DHCP server etc.
I have exhausted my reading and comprehending what to do to troubleshoot this problem so I am reaching out.
Do i need to install drivers for the Mellanox card into Proxmox? Or tweak something? Or is this just not going to work?
Thanks for looking.
Snorf
Last edited: