Here's the overview:
SETUP
Proxmox 5.4-5, ZoL 0.7.13-pve1~bpo1
4x 2-way mirrored vdevs
atime=off,xattr=sa,sync=disabled,compression=off,recordsize=1M
WRITE
I was expecting to saturate my 10G network on sequential reads... No idea what's going on! During the tests, reads/writes are evenly distributed to all disks. zpool iostat shows ~850MB/s total bandwidth during writes to all 8 drives (makes sense, about 100-120MB/s per drive), but reads total those 400-450MB/s bandwidth, with about 50-60MB/s per drive...
I'm incredibly puzzled! :X
Any help and ideas would be greatly appreciated!
Thank you in advance!
--LF
PS: I ran bonnie++ tests as well, with very similar results.
SETUP
Proxmox 5.4-5, ZoL 0.7.13-pve1~bpo1
4x 2-way mirrored vdevs
atime=off,xattr=sa,sync=disabled,compression=off,recordsize=1M
WRITE
READ# dd if=/dev/zero of=bench.bin bs=1M count=120000
120000+0 records in
120000+0 records out
125829120000 bytes (126 GB, 117 GiB) copied, 305.644 s, 412 MB/s
POOL LAYOUT# dd if=bench.bin of=/dev/null bs=1M count=120000
120000+0 records in
120000+0 records out
125829120000 bytes (126 GB, 117 GiB) copied, 307.467 s, 409 MB/s
Code:
pool: storage
state: ONLINE
scan: none requested
config:
NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
ata-WDC_WD80EFAX-68LHPN0_7SGJ7E3C ONLINE 0 0 0
ata-WDC_WD80EMAZ-00WJTA0_7JKZ5TSC ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
ata-WDC_WD80EFAX-68LHPN0_7SGBY56C ONLINE 0 0 0
ata-WDC_WD80EMAZ-00WJTA0_7JKWPLYC ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
ata-WDC_WD80EFAX-68LHPN0_7SGKYW3C ONLINE 0 0 0
ata-WDC_WD80EMAZ-00WJTA0_7SH0YT6G ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
ata-WDC_WD80EMAZ-00WJTA0_7SH0W5HG ONLINE 0 0 0
ata-WDC_WD80EMAZ-00WJTA0_7SH0WKNG ONLINE 0 0 0
I'm incredibly puzzled! :X
Any help and ideas would be greatly appreciated!
Thank you in advance!
--LF
PS: I ran bonnie++ tests as well, with very similar results.