Qotom Denverton fanless system with 4 SFP+

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

John T Davis

Active Member
Nov 19, 2022
109
26
28
If you want the latest revision, Qotom sells Q20331G9 V1.2 C3758R on their AliExpress store.
However, I'm not sure if their new cooling solution is an upgrade or a downgrade.
...Why did this have to get so complicated? I do so love multiple revisions of the same product with an unclear changelog. I always get turned around buying from vendors on AliExpress. :p
 

siematos

Member
Dec 7, 2021
46
32
18
Thanks!

Are you testing the desktop vs. rackmount, or deploying both of them?
One's getting colocated in a datacenter, the passively cooled one stays at home, but I'll be testing them both at home first. I was going to play around with MLVPN on FreeBSD, to bond 5G, cable and landline connections.
 

John T Davis

Active Member
Nov 19, 2022
109
26
28
One's getting colocated in a datacenter, the passively cooled one stays at home, but I'll be testing them both at home first. I was going to play around with MLVPN on FreeBSD, to bond 5G, cable and landline connections.
Very cool. Now that I know I can buy directly from them at good prices, I'm seriously considering the desktop/passively cooled one. That's ... probably good enough for bare metal OPNSense. If I got that one, I'd be strongly tempted to stash it in the closet and finally run fiber from the office closet to the network rack in my office.

OTOH, it would be nice to finally have my core network devices all in the same rack. :p

Decisions, decisions. ;)
 

siematos

Member
Dec 7, 2021
46
32
18
Very cool. Now that I know I can buy directly from them at good prices, I'm seriously considering the desktop/passively cooled one. That's ... probably good enough for bare metal OPNSense. If I got that one, I'd be strongly tempted to stash it in the closet and finally run fiber from the office closet to the network rack in my office.

OTOH, it would be nice to finally have my core network devices all in the same rack. :p

Decisions, decisions. ;)
I've had my experiences with servers in my living room. It wasn't pleasant, to say the least.

My requirements were the following:
Sub 50 Watts for the Datacenter (because it's dirt cheap at that usage, 29$ for 10TB traffic/month, 1gbit in 1U @ 50VA - plus extras, if you need them)
Passively cooled for the home
If possible, the same design to keep maintenance low
Good support for FreeBSD
10gbit

The N150/N355/laptop-based models would probably satisfy most of those, but Denverton Atoms got the X553 built into the cpu, while X710/other ethernet controllers typically need some form of active cooling.
 

John T Davis

Active Member
Nov 19, 2022
109
26
28
<deletia>

My requirements were the following:
Sub 50 Watts for the Datacenter (because it's dirt cheap at that usage, 29$ for 10TB traffic/month, 1gbit in 1U @ 50VA - plus extras, if you need them)
Passively cooled for the home
If possible, the same design to keep maintenance low
Good support for FreeBSD
10gbit

The N150/N355/laptop-based models would probably satisfy most of those, but Denverton Atoms got the X553 built into the cpu, while X710/other ethernet controllers typically need some form of active cooling.
I'm about sold on trying the fanless one. :)

Do you have any real performance concerns for putting the fanless unit in a home/home office?
 

siematos

Member
Dec 7, 2021
46
32
18
I'm about sold on trying the fanless one. :)

Do you have any real performance concerns for putting the fanless unit in a home/home office?
I doubt, that I'll be capable of stressing the device, to be honest. Hardware acceleration is doing the heavy lifting. I'm not sure, if i'd use it for virtualization workloads or as a file storage with internal drives. passive cooled temperatures with closed enclosures are typically hostile for drives. The rest should be fine. I will be running network functions on it though.
 
  • Like
Reactions: John T Davis

John T Davis

Active Member
Nov 19, 2022
109
26
28
I doubt, that I'll be capable of stressing the device, to be honest. Hardware acceleration is doing the heavy lifting. I'm not sure, if i'd use it for virtualization workloads or as a file storage with internal drives. passive cooled temperatures with closed enclosures are typically hostile for drives. The rest should be fine. I will be running network functions on it though.
Awesome. I'd definitely just be using it for baremetal OPNSense.
I'm not opposed to virtualizing OPNSense, but it's a whole vector of potential problems that I don't want in the firewall that I use to work from home.
 

siematos

Member
Dec 7, 2021
46
32
18
Awesome. I'd definitely just be using it for baremetal OPNSense.
I'm not opposed to virtualizing OPNSense, but it's a whole vector of potential problems that I don't want in the firewall that I use to work from home.
I'd say OPNSense as a virtual appliance is fairly standard now, I'd be surprised if there are still issues. When I talk about virtualized workloads, then I'm thinking about high-load virtualized services like transcoding media, build-bots/ci, or even VPNs - if it didn't have Intel QuickAssist.

Since the one that goes into the datacenter is actively cooled, that one will be an off-site backup as well with 1-2 large SATA drives.

I'm typically running a virtualized network, with DNS/DHCP/CAPWAP controller/... that are cheap to run in jails. I'm still thinking about running OpenWRT as an AP on BHyve with a wifi card passthrough. I'm very sceptic about this though, since we're talking about passively cooling a wifi AP card in a closed enclosure. Also, a BananaPi R3 mini costs like 130$, and an OpenWRT One is even cheaper (but larger/uglier). Many choices, and not enough answers :<
 
Last edited:

John T Davis

Active Member
Nov 19, 2022
109
26
28
I'd say OPNSense as a virtual appliance is fairly standard now, I'd be surprised if there are still issues. When I talk about virtualized workloads, then I'm thinking about high-load virtualized services like transcoding media, build-bots/ci, or even VPNs - if it didn't have Intel QuickAssist.

Since the one that goes into the datacenter is actively cooled, that one will be an off-site backup as well with 1-2 large SATA drives.

I'm typically running a virtualized network, with DNS/DHCP/CAPWAP controller/... that are cheap to run in jails. I'm still thinking about running OpenWRT as an AP on BHyve with a wifi card passthrough. I'm very sceptic about this though, since we're talking about passively cooling a wifi AP card in a closed enclosure. Also, a BananaPi R3 mini costs like 130$, and an OpenWRT One is even cheaper (but larger/uglier). Many choices, and not enough answers :<
Honestly, I'd love to try this at some point, but I can't afford to take my entire home/work offline while I get it working. Maybe in the future. :)
If I could run my firewall/DNS/VPN and Proxmox Backup Server on the same box with a couple of SATA SSDs, that'd be ideal.

I'm a bit surprised that the C3758R is enough for all that. The way some people write about it, it's getting a bit too dated.
 

siematos

Member
Dec 7, 2021
46
32
18
Honestly, I'd love to try this at some point, but I can't afford to take my entire home/work offline while I get it working. Maybe in the future. :)
If I could run my firewall/DNS/VPN and Proxmox Backup Server on the same box with a couple of SATA SSDs, that'd be ideal.

I'm a bit surprised that the C3758R is enough for all that. The way some people write about it, it's getting a bit too dated.
if you use a direct attached storage with that SFF8087 port, that shouldn't be an issue. I'm just sceptical of a drive's lifetime, if you put it inside the passively cooled enclosure without ventilation. Careful with compression though, that can increase the load significantly. Should be fine to run some cheap compression algorithm. Any reason, why you want to use SSDs? HDDs should be a lot cheaper and for backups, you probably wouldn't care tooo much about IOps.
 
  • Like
Reactions: John T Davis

John T Davis

Active Member
Nov 19, 2022
109
26
28
Any reason, why you want to use SSDs? HDDs should be a lot cheaper and for backups, you probably wouldn't care tooo much about IOps.
I've already got an 8-bay HDD NAS 4x ZFS mirrors (RAID1), with ~52 TiB of space, with a 2x10GbE link.

My current PBS server is an Intel N6005 machine with 64 GiB of RAM and a 2x2.5 GbE connection, with 2x1.92 TB enterprise SATA SSDs.
If i moved Proxmox Backup Server onto this machine, I'd still want it backing up on to those SSDs, for max speed since it's suspending and backing up running VM and LXC containers. (Due to how PBS works, including deduplication and breaking backups into chunks, backing up directly to an HDD array is not recommended.)

That Promxox Backup Server then sends a copy of those backups over to the HDD array on the NAS, with no performance impact on the VMs since it's a backup-of-a-backup.
 

siematos

Member
Dec 7, 2021
46
32
18
I've already got an 8-bay HDD NAS 4x ZFS mirrors (RAID1), with ~52 TiB of space, with a 2x10GbE link.

My current PBS server is an Intel N6005 machine with 64 GiB of RAM and a 2x2.5 GbE connection, with 2x1.92 TB enterprise SATA SSDs.
If i moved Proxmox Backup Server onto this machine, I'd still want it backing up on to those SSDs, for max speed since it's suspending and backing up running VM and LXC containers. (Due to how PBS works, including deduplication and breaking backups into chunks, backing up directly to an HDD array is not recommended.)

That Promxox Backup Server then sends a copy of those backups over to the HDD array on the NAS, with no performance impact on the VMs since it's a backup-of-a-backup.
In that case, let me compare both the N6005 and the C3758R for you: from the pure core-per-core perspective, the C3758R should be ~half as powerful, but it's got twice the cores. What really moves the needle is hardware acceleration. Intel QuickAssist gives acceleration for encryption and compression tasks, so in these workload categories, the cores punch way above their weight compared to the N6005. I don't know that much about Proxmox, but from a pure backup perspective, you typically have some write cache in front of HDDs, and with a 7200RPM HDD, you can write with like 300-400+ MB/s to a ZRAID10. That's why I was surprised.
 

John T Davis

Active Member
Nov 19, 2022
109
26
28
In that case, let me compare both the N6005 and the C3758R for you: from the pure core-per-core perspective, the C3758R should be ~half as powerful, but it's got twice the cores. What really moves the needle is hardware acceleration. Intel QuickAssist gives acceleration for encryption and compression tasks, so in these workload categories, the cores punch way above their weight compared to the N6005.
That is indeed instructive. Wow. I knew the C3758R was old, but The N6005 isn't exactly new, either. These sorts of comparisons are a lot more useful to me than raw benchmarks. I just don't look at enough of those to be able to absorb them well.

I don't know that much about Proxmox, but from a pure backup perspective, you typically have some write cache in front of HDDs, and with a 7200RPM HDD, you can write with like 300-400+ MB/s to a ZRAID10. That's why I was surprised.
Proxmox Backup Server supports encrypting backups as they're made, and primarily works by breaking data on a filesystem into chunks and storing those--which allows for deduplication without using ZFS deduplication, along with other performance enhancements versus just using a file-based backup.

I don't know how PBS leverages Intel QAT, but now I'm curious to know. I'll post a thread on the PBS forum and let you know what I find out. :)

For the moment, at least, I'm still planning on using the Qotom as a bare metal OPNSense box.
I'm planning to upgrade my Proxmox server from a 12th gen Intel Mini PC to something beefier later this year, and want to wait until that's done (and I actually have some PCIe slots to use for NICs) before experimenting with virtualizing OPNSense (or, I could just take my current Proxmox server with its 17-12700T and make it my OPNSense box).
 

siematos

Member
Dec 7, 2021
46
32
18
That is indeed instructive. Wow. I knew the C3758R was old, but The N6005 isn't exactly new, either. These sorts of comparisons are a lot more useful to me than raw benchmarks. I just don't look at enough of those to be able to absorb them well.
It's a 10nm part at least, But really, QuickAssist pushes the C3758R's performance to about ~20-25% higher than the N6005 in encryption and compression.

How CPU or RAM gated are those Proxmox backups? Sounds like an expensive thing to do.