I have tried 10gtek and another brand 10gbaseT receivers as well as a Fiber receiver, and everything at least in ix0 is slow. I'll test is on another sfp port this week to see if that is the issue.
Thanks!
Qotom Denverton fanless system with 4 SFP+
- Thread starter is39
- Start date
Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
Thanks!
Could you be a bit more descriptive? Is the resulting network speed slow? Does the device in general become slow to interact with?
I haven't looked at this deeply but I do have two I'm playing with, although I'm not seeing much as far a details for configuring it in pfSense.
Trying to get this to work via Google Fi cellular service running on T-Mobil here in the US.
I'd just like secondary ISP option. I may resort to adding a cable option if I can get them down to a cheap enough monthly cost. At that point I may still look to get the cellular as a tertiary option as I currently have unlimited data, and unlimited free data sims.
So the network speed comes to a crawl. I see excellent upload speeds but horrible download speeds (around 100 Mbps) This is with a 5 Gbps google fiber connection. But upload speeds seem to be good and accurate. I tried with OPNsense, VyOS and having the same issue.
Weird. Trying on a different port made no difference?
It doesn't match what others have seen, so there must be something different with your setup or device. Are you able to do a local test with iperf3 or something just to check whether that exhibits the same symptoms?
I can try running an iperf test and see what happens. Its absolutely really wierd.
Got C3758R in 1U with rj45 and SFP+ ports. That 1U case is designed very badly. There should be no fan intake/outtake under enclosure as in rack there are other devices under, blocking that fan. Airflow should be from front (or sides) to back. The other problem with this design (fan under PCB) is that NVME drives get zero airflow.
Anyway even with fan hole not being blocked by anything the device here runs at 70C and so far I never saw that fan running. Also didn't find any fan settings in BIOS (QDNV0121.V10), so no idea what's going on. Fan itself is working (if I power it from external 5V).
Any ideas how to get this fan working? (using pfsense)
ps. fan is BROAD FAN Model: BF07505H05FP, DC 5V, 0.50A, SHENZHEN BROADWAY TECHNOLOGY CO LTD, 4 wires
ps2. under PCB there is a unpopulated place for second fan connector... I wonder if it would be active if connector got added
Anyway even with fan hole not being blocked by anything the device here runs at 70C and so far I never saw that fan running. Also didn't find any fan settings in BIOS (QDNV0121.V10), so no idea what's going on. Fan itself is working (if I power it from external 5V).
Any ideas how to get this fan working? (using pfsense)
ps. fan is BROAD FAN Model: BF07505H05FP, DC 5V, 0.50A, SHENZHEN BROADWAY TECHNOLOGY CO LTD, 4 wires
ps2. under PCB there is a unpopulated place for second fan connector... I wonder if it would be active if connector got added
Have a multimeter as you can easily measure the voltage on the pins. Look up a pin out and you should be able to tell what pin is what to compare.
I bought the Qotom Q20331G9 1U Rackmount version. It shipped in 2 days from China which is insane. I installed PfSense on it and it was running like butter for about 2 hours. Then it died. Anyone else have problems or did I just get a dud? I've been working with the seller through Amazon but they keep asking me what seem to be irrelevant questions. Also the communication is delayed as most of their business hours are when I'm sleeping. I'm hoping they will send me a new board to cut down on shipping but we'll see.
I have the desk mount appliance as I was unaware of the rack mount version. I've been running since the beginning of March. Hasn't been an issue, although waiting for Honeywell PTM7950 SP to come in to swap out TIM to hope to run cooler.
Bought the rack mount as well. Noticed that if I have a RJ45 SFP+ Module in one of the sfp cages, it will not cold boot. Power supply lights come on, but power light on the panel does not and it appears dead.
Here is a list of tested compatible RAM. Sure would like to find a source of the ECC stuff. I'm ordering this inexpensive ECC stuff 64GB Kit 2 x 32GB DDR4-2666 PC4-21300 ECC Sodimm 2Rx8 Memory by Nemix Ram - Newegg.com and will report back on compatibility (Nemix seems to use Micron chips.)
Last edited:
I‘ve had the Qotom Q20331G9 1U version for more than a month running OPNsense 13.2 today I did some tuning to get better 10 GB performance Setting used and iperf3 results.
C:
{ sysctl -a | grep -i "hw.machine\|hw.model\|hw.ncpu"; sysctl -n hw.physmem | awk '{ byte =$1 /1024/1024/1024; print byte " GB" }'; }
hw.machine: amd64
hw.model: Intel(R) Atom(TM) CPU C3758R @ 2.40GHz
hw.ncpu: 8
hw.machine_arch: amd64
15.932 GB
C:
System: Settings: Tunables
(qat),CRC,LRO=enable
dev.ix.0.fc=0
dev.ix.1.fc=0
hw.ibrs_disable=1
hw.ix.flow_control=0
net.isr.maxthreads=-1
net.isr.bindthreads=1
net.isr.dispatch=deferred
net.inet.rss.enabled=1
net.inet.rss.bits=3
net.inet.tcp.soreceive_stream=0 (default 0)
net.inet.tcp.tso=1 (default 1)
C:
sudo netstat -Q
Configuration:
Setting Current Limit
Thread count 8 8
Default queue limit 256 10240
Dispatch policy deferred n/a
Threads bound to CPUs enabled n/a
Protocols:
Name Proto QLimit Policy Dispatch Flags
ip 1 1000 cpu hybrid C--
igmp 2 256 source default ---
rtsock 3 256 source default ---
arp 4 256 source default ---
ether 5 256 cpu direct C--
ip6 6 1000 cpu hybrid C--
ip_direct 9 256 cpu hybrid C--
ip6_direct 10 256 cpu hybrid C--
sudo sysctl -a | grep -i "net.isr\|net.rss\|hw.ix"
net.inet.rss.bucket_mapping: 0:0 1:1 2:2 3:3 4:4 5:5 6:6 7:7
net.inet.rss.enabled: 1
net.inet.rss.debug: 0
net.inet.rss.basecpu: 0
net.inet.rss.buckets: 8
net.inet.rss.maxcpus: 64
net.inet.rss.ncpus: 8
net.inet.rss.maxbits: 7
net.inet.rss.mask: 7
net.inet.rss.bits: 3
net.inet.rss.hashalgo: 2
net.isr.numthreads: 8
net.isr.maxprot: 16
net.isr.defaultqlimit: 256
net.isr.maxqlimit: 10240
net.isr.bindthreads: 1
net.isr.maxthreads: 8
net.isr.dispatch: deferred
hw.ixl.flow_control: -1
hw.ixl.tx_itr: 122
hw.ixl.rx_itr: 62
hw.ixl.shared_debug_mask: 0
hw.ixl.core_debug_mask: 0
hw.ixl.enable_head_writeback: 0
hw.ixl.enable_vf_loopback: 1
hw.ixl.i2c_access_method: 0
hw.ix.enable_aim: 0
hw.ix.enable_rss: 1
hw.ix.enable_fdir: 0
hw.ix.unsupported_sfp: 0
hw.ix.enable_msix: 1
hw.ix.advertise_speed: 0
hw.ix.flow_control: 0
hw.ix.max_interrupt_rate: 31250
C:
ifconfig -v ix0
ix0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=4e03c2b<RXCSUM,TXCSUM,VLAN_MTU,JUMBO_MTU,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
ether *:8a
media: Ethernet autoselect (10Gbase-SR <full-duplex>)
status: active
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
plugged: SFP/SFP+/SFP28 10G Base-SR (LC)
vendor: BROCADE PN: 57-0000075-01 SN: * DATE: 2013-07-03
module temperature: 52.80 C voltage: 3.35 Volts
lane 1: RX power: 0.57 mW (-2.41 dBm) TX bias: 8.71 mA
ifconfig -v ix1
ix1: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=4e03c2b<RXCSUM,TXCSUM,VLAN_MTU,JUMBO_MTU,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
ether *:8a
hwaddr *:8b
media: Ethernet autoselect (10Gbase-SR <full-duplex>)
status: active
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
plugged: SFP/SFP+/SFP28 10G Base-SR (LC)
vendor: BROCADE PN: 57-0000075-01 SN: * DATE: 2013-07-03
module temperature: 48.05 C voltage: 3.31 Volts
lane 1: RX power: 0.65 mW (-1.90 dBm) TX bias: 8.57 mA
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: LAN1 (opt1)
options=4e03c2b<RXCSUM,TXCSUM,VLAN_MTU,JUMBO_MTU,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
ether *:8a
inet 172.16.99.1 netmask 0xfffffffc broadcast 172.16.99.3
inet6 * prefixlen 64 scopeid 0xe
inet6 * prefixlen 64
laggproto lacp lagghash l2,l3,l4
lagg options:
flags=0<>
flowid_shift: 16
lagg statistics:
active ports: 2
flapping: 0
lag id:
laggport: ix0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
laggport: ix1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
groups: lagg
media: Ethernet autoselect
status: active
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
C:
Windows 10 8c/16gb Proxmox VM
iperf3 -c 172.16.50.100 -P8 -p5001
[ ID] Interval Transfer Bitrate Retr
[SUM] 0.00-10.05 sec 8.32 GBytes 7.10 Gbits/sec 7054 sender
[SUM] 0.00-10.05 sec 8.31 GBytes 7.10 Gbits/sec receiver
iperf3 -c 172.16.50.100 -P8 -p5001 -R
[ ID] Interval Transfer Bitrate Retr
[SUM] 0.00-10.01 sec 8.46 GBytes 7.26 Gbits/sec sender
[SUM] 0.00-10.00 sec 8.44 GBytes 7.25 Gbits/sec receiver
iperf3 -c 172.16.50.100 -P50 -p5001
[ ID] Interval Transfer Bitrate Retr
[SUM] 0.00-10.00 sec 8.31 GBytes 7.14 Gbits/sec 63307 sender
[SUM] 0.00-10.01 sec 8.24 GBytes 7.07 Gbits/sec receiver
iperf3 -c 172.16.50.100 -P50 -p5001 -R
Reverse mode,
[ ID] Interval Transfer Bitrate Retr
[SUM] 0.00-10.25 sec 9.38 GBytes 7.86 Gbits/sec sender
[SUM] 0.00-10.00 sec 9.30 GBytes 7.99 Gbits/sec receive
Loopback Test
iperf3 -c 172.16.99.1 -p5001
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 13.9 GBytes 11.9 Gbits/sec 0 sender
[ 5] 0.00-10.00 sec 13.9 GBytes 11.9 Gbits/sec receiver
iperf3 -c 172.16.99.1 -P4 -p5001
[ ID] Interval Transfer Bitrate Retr
[SUM] 0.00-10.00 sec 23.6 GBytes 20.3 Gbits/sec 207 sender
[SUM] 0.00-10.00 sec 23.6 GBytes 20.3 Gbits/sec receiver
iperf3 -c 172.16.99.1 -P8 -p5001
[SUM] 0.00-10.00 sec 32.7 GBytes 28.0 Gbits/sec 772 sender
[SUM] 0.00-10.00 sec 32.7 GBytes 28.0 Gbits/sec receiver
perf3 -c 172.16.99.1 -P50 -p5001
[ ID] Interval Transfer Bitrate Retr
[SUM] 0.00-10.01 sec 33.9 GBytes 29.1 Gbits/sec 1191 sender
[SUM] 0.00-10.01 sec 33.9 GBytes 29.0 Gbits/sec receiver
perf3 -c 172.16.99.1 -P50 -p5001 -R
[ ID] Interval Transfer Bitrate Retr
[SUM] 0.00-10.02 sec 33.2 GBytes 28.5 Gbits/sec 1541 sender
[SUM] 0.00-10.00 sec 33.0 GBytes 28.4 Gbits/sec receiverYou can get the Sk hynix ECC 32G sodimms mentioned in the list at newegg. Ordered one, that one tested and has worked fine so far. Ordered another which is due to arrive tomorrow or it will be late. Shipping isn't fast unless you pay high shipping fees. And yes, it's quite a bit more expensive than the Nemix. SK Hynix HMAA4GS7AJR8N-VK T0 DDR4 32GB 2666Mhz 2Rx8 PC4-21300 ECC CL19 260-Pin SODIMM 1.2V Memory Module for Notebook Thinkpad P53 P73 - Newegg.com
Nice, I couldn't find it. If my stuff proves incompatible, we have confirmed compatible source. Hopefully the Nemix memory is compatible and saves me $65.
Last edited:
I have a 16GB (2x8Gb) kit of Nemix ram running just fine in it.
Heck, the original 16GB I ran with for a day (mixed pair of 8GB DIMMs) didn't cause any issues with booting.
So... been reading, and watching and deciding and what not, and finally cut the knot. bought the 1u rack version C3758.
Planning to proxmox it with pfsense to use it primarily as router, using disk passthrough for the pfsense that incase proxmox dies, i can boot from the passthrough device directly.
The only thing i'm really wondering about that i cannot find...
How do you guys do the initial installation? Do you actually use the VGA port, is the USB-C display ready, maybe even install proxmox using the console port?
Would love to hear from you guys
Planning to proxmox it with pfsense to use it primarily as router, using disk passthrough for the pfsense that incase proxmox dies, i can boot from the passthrough device directly.
The only thing i'm really wondering about that i cannot find...
How do you guys do the initial installation? Do you actually use the VGA port, is the USB-C display ready, maybe even install proxmox using the console port?
Would love to hear from you guys
I used a cheap VGA adapter since I didn't have a monitor with VGA available. I tried to use the console port but didn't manage to get an output from it. You might have to enable it in the BIOS for it to be usable, which would require VGA to do.
I don't think the USB-C port supports display output since the only GPU is the ASPEED chip on the board.
Alright, yeah i didn't think the aspeed would support video over usb-c.
That's odd tho, no output from the console port? Whats it there for than i wonder...
Can't wait to hear how others have done it! (looking like ill use my old 17" with vga in the attic)
I've seen others say they got it working in the comments on the review article, but they didn't specify how. You might have to enable console redirection in the BIOS etc. In the end, I didn't feel like digging deeper once I bought the VGA adapter.