I recently purchased a ZeusRAM Z4RZF3D-8UC for use as a ZIL on my storage server now that I'm planning to switch to iSCSI. I put it in my 4 drive pair of mirrors lab test box. I ran benchmarks and didn't get nearly the 4k results I expected. I pulled the drive and put it in one of my R710's for testing. I was using a Dell PERC H200 SAS controller (crossflashed to a 9211-8i) with a 4 port breakout cable in both the lab test box and my R710. Here are the benchmark results obtained on the Windows server:
-----------------------------------------------------------------------
CrystalDiskMark 5.1.2 x64 (C) 2007-2016 hiyohiyo
Crystal Dew World : Crystal Dew World
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes
Sequential Read (Q= 32,T= 1) : 499.837 MB/s
Sequential Write (Q= 32,T= 1) : 448.735 MB/s
Random Read 4KiB (Q= 32,T= 1) : 242.902 MB/s [ 59302.2 IOPS]
Random Write 4KiB (Q= 32,T= 1) : 204.272 MB/s [ 49871.1 IOPS]
Sequential Read (T= 1) : 449.006 MB/s
Sequential Write (T= 1) : 419.027 MB/s
Random Read 4KiB (Q= 1,T= 1) : 53.130 MB/s [ 12971.2 IOPS]
Random Write 4KiB (Q= 1,T= 1) : 47.684 MB/s [ 11641.6 IOPS]
Test : 100 MiB [E: 0.5% (36.0/7627.0 MiB)] (x1) [Interval=5 sec]
Date : 2016/09/09 21:04:55
OS : Windows Server 2012 R2 [6.3 Build 9600] (x64)
Those results don't look remotely like what I anticipated seeing on 4k writes. According to the spec sheets, it should be capable of the following specs:
Performance
Latency Average (ms)
<23µs /<23µs
Read Throughput (max MB/s, sequential 64k)
900/475
Write Throughput (max MB/s, sequential 64K)
800/430
Read IOPS (max IOPS, random 4k)
100,000/69,000
Write IOPS (max IOPS, random 4k)
100,000/51,000
Do you guys think this is due to controller or cables perhaps? If not, any ideas? The drive was listed as new when I purchased it...
-----------------------------------------------------------------------
CrystalDiskMark 5.1.2 x64 (C) 2007-2016 hiyohiyo
Crystal Dew World : Crystal Dew World
-----------------------------------------------------------------------
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes
Sequential Read (Q= 32,T= 1) : 499.837 MB/s
Sequential Write (Q= 32,T= 1) : 448.735 MB/s
Random Read 4KiB (Q= 32,T= 1) : 242.902 MB/s [ 59302.2 IOPS]
Random Write 4KiB (Q= 32,T= 1) : 204.272 MB/s [ 49871.1 IOPS]
Sequential Read (T= 1) : 449.006 MB/s
Sequential Write (T= 1) : 419.027 MB/s
Random Read 4KiB (Q= 1,T= 1) : 53.130 MB/s [ 12971.2 IOPS]
Random Write 4KiB (Q= 1,T= 1) : 47.684 MB/s [ 11641.6 IOPS]
Test : 100 MiB [E: 0.5% (36.0/7627.0 MiB)] (x1) [Interval=5 sec]
Date : 2016/09/09 21:04:55
OS : Windows Server 2012 R2 [6.3 Build 9600] (x64)
Those results don't look remotely like what I anticipated seeing on 4k writes. According to the spec sheets, it should be capable of the following specs:
Performance
Latency Average (ms)
<23µs /<23µs
Read Throughput (max MB/s, sequential 64k)
900/475
Write Throughput (max MB/s, sequential 64K)
800/430
Read IOPS (max IOPS, random 4k)
100,000/69,000
Write IOPS (max IOPS, random 4k)
100,000/51,000
Do you guys think this is due to controller or cables perhaps? If not, any ideas? The drive was listed as new when I purchased it...