So I got myself a bunch of SSDs recently (total 12x S3700/400 GB) and wanted to evaluate the actual scaling factor of ZFS mirrors. So I set up Napp-It (OI2017.04, not updated) and started blasting away on the disk with bonnie.
The Box is an Intel Server with an 2630Lv4 [M0](10C,1.7 G base), 64 GB Ram total, 12xS3700 400GB on a M1215 with 12G expander (Res30).
The actual tests are on a VM with passs through of the M1215, 4 Cores, 16GB
The results are not really what I was expecting - scale up kind of stopped at 4 mirrors...
Now there are a lot of potential reasons - cpu maxed, interface limitation or probably a lot more. Just wonder which one it actually is...
Code:
NAME SIZE Mirrors Date(y.m.d) File Seq-Wr-Chr %CPU Seq-Write %CPU Seq-Rewr %CPU Seq-Rd-Chr %CPU Seq-Read %CPU Rnd Seeks %CPU Files Seq-Create Rnd-Create
testpool 372G 1 2017.10.18 32G 235 MB/s 72 251 MB/s 26 175 MB/s 20 280 MB/s 99 606 MB/s 26 13079,2/s 19 16 +++++/s +++++/s
testpool 744G 2 2017.10.18 32G 358 MB/s 98 480 MB/s 46 337 MB/s 42 271 MB/s 99 1046 MB/s 47 13830.2/s 21 16 +++++/s +++++/s
testpool 1.09T 3 2017.10.20 32G 356 MB/s 97 696 MB/s 69 492 MB/s 60 266 MB/s 99 1494 MB/s 65 13691.2/s 24 16 +++++/s +++++/s
testpool 1.45T 4 2017.10.20 32G 362 MB/s 97 999 MB/s 94 705 MB/s 88 279 MB/s 99 1872 MB/s 84 15700.1/s 26 16 +++++/s +++++/s
testpool 1.82T 5 2017.10.20 32G 361 MB/s 96 949 MB/s 92 701 MB/s 92 270 MB/s 99 2063 MB/s 93 +++++/s +++ 16 +++++/s +++++/s
testpool 2.18T 6 2017.10.20 32G 347 MB/s 95 917 MB/s 89 716 MB/s 90 272 MB/s 99 2067 MB/s 97 15800.0/s 33 16 +++++/s +++++/s
The Box is an Intel Server with an 2630Lv4 [M0](10C,1.7 G base), 64 GB Ram total, 12xS3700 400GB on a M1215 with 12G expander (Res30).
The actual tests are on a VM with passs through of the M1215, 4 Cores, 16GB
The results are not really what I was expecting - scale up kind of stopped at 4 mirrors...
Now there are a lot of potential reasons - cpu maxed, interface limitation or probably a lot more. Just wonder which one it actually is...
Last edited: