I just finished setting up my open indiana VM inside ESXi 4.1U3 (i'll explain that) and wanted some of the ZFS guys to look at the zfs output (i'll post whatever) and make sure that I'm not missing anything obvious or doing anything stupid before I go moving data to it and making it "live".
Spec:
Supermicro X8DTE-F dual CPU MB with 7 8x PCI-E slots and 12 RAM slots
2x L5520 Xeon 2.4GHZ Quad Core / HyperThreaded 16 threads total
24GB RDIMM (another 24GB on the way and it will be full up with 48GB next week)
1 LSI 3081E-R 8 port 3gb SAS
1 M1015 8 port 6gb SAS (in IT mode)
8 10k RPM 300GB Raptor 2.5" drives in RAID10
8 2TB drives (mixed) in RAIDz2 (not hung up on this, will do RAID10 if needed)
2 port DDR infiniband for 10Gb/s networking
I'm seeing 170-200MB/s on VMs (NFS) on the RAID10 pool, 250-300MB/s copy's between RAM/SSD to the same pool using SMB. I'm seeing roughly similar speeds on file copies to the RAIDz2 pool using SMB. DD bench is showing 400-450MB/s writes and 600-650MB/s reads on both pools but I could be doing something wrong with it. Just wanting to make sure set it up correctly.
Here is my ZFS outputs from Napp-it. Let me know if you need to see anything else:
https://dl.dropboxusercontent.com/u/10627065/ZFS_server_stats.txt
ZFSinfos hash zfs:
RAIDz2/10TB_RAIDZ2_avail 9.13T
RAIDz2/10TB_RAIDZ2_compression off
RAIDz2/10TB_RAIDZ2_dedup off
RAIDz2/10TB_RAIDZ2_mountpoint /RAIDz2/10TB_RAIDZ2
RAIDz2/10TB_RAIDZ2_nbmand on
RAIDz2/10TB_RAIDZ2_quota none
RAIDz2/10TB_RAIDZ2_readonly off
RAIDz2/10TB_RAIDZ2_refquota none
RAIDz2/10TB_RAIDZ2_refreservation none
RAIDz2/10TB_RAIDZ2_reservation none
RAIDz2/10TB_RAIDZ2_sharenfs rw
RAIDz2/10TB_RAIDZ2_sharesmb name=10TB_RAIDZ2,guestok=true
RAIDz2/10TB_RAIDZ2_sync standard
RAIDz2/10TB_RAIDZ2_used 7.73G
RAIDz2/Business_avail 9.13T
RAIDz2/Business_compression on
RAIDz2/Business_dedup off
RAIDz2/Business_mountpoint /RAIDz2/Business
RAIDz2/Business_nbmand on
RAIDz2/Business_quota none
RAIDz2/Business_readonly off
RAIDz2/Business_refquota none
RAIDz2/Business_refreservation none
RAIDz2/Business_reservation none
RAIDz2/Business_sharenfs off
RAIDz2/Business_sharesmb name=Business,guestok=true
RAIDz2/Business_sync standard
RAIDz2/Business_used 341K
RAIDz2/Public_avail 9.13T
RAIDz2/Public_compression on
RAIDz2/Public_dedup off
RAIDz2/Public_mountpoint /RAIDz2/Public
RAIDz2/Public_nbmand on
RAIDz2/Public_quota none
RAIDz2/Public_readonly off
RAIDz2/Public_refquota none
RAIDz2/Public_refreservation none
RAIDz2/Public_reservation none
RAIDz2/Public_sharenfs off
RAIDz2/Public_sharesmb name=Public,guestok=true
RAIDz2/Public_sync standard
RAIDz2/Public_used 341K
RAIDz2/images_avail 9.13T
RAIDz2/images_compression off
RAIDz2/images_dedup off
RAIDz2/images_mountpoint /RAIDz2/images
RAIDz2/images_nbmand on
RAIDz2/images_quota none
RAIDz2/images_readonly off
RAIDz2/images_refquota none
RAIDz2/images_refreservation none
RAIDz2/images_reservation none
RAIDz2/images_sharenfs off
RAIDz2/images_sharesmb name=images,guestok=true
RAIDz2/images_sync standard
RAIDz2/images_used 341K
RAIDz2_avail 10.1T
RAIDz2_compression off
RAIDz2_dedup off
RAIDz2_mountpoint /RAIDz2
RAIDz2_nbmand off
RAIDz2_quota none
RAIDz2_readonly off
RAIDz2_refquota none
RAIDz2_refreservation 1.01T
RAIDz2_reservation none
RAIDz2_sharenfs off
RAIDz2_sharesmb off
RAIDz2_sync standard
RAIDz2_used 1.02T
allfs RAIDz2 RAIDz2/10TB_RAIDZ2 RAIDz2/Business RAIDz2/Public RAIDz2/images raptor10k-RAID10 raptor10k-RAID10/1TB_speed raptor10k-RAID10/VMware
allpools RAIDz2 raptor10k-RAID10 rpool
buffertime 1368820854
datapools RAIDz2 raptor10k-RAID10
properties type creation used available referenced compressratio mounted quota reservation recordsize mountpoint sharenfs checksum compression atime devices exec setuid readonly zoned snapdir aclmode aclinherit canmount xattr copies version utf8only normalization casesensitivity vscan nbmand sharesmb refquota refreservation primarycache secondarycache usedbysnapshots usedbydataset usedbychildren usedbyrefreservation logbias dedup mlslabel sync refcompressratio writtentype creation used available referenced compressratio mounted quota reservation recordsize mountpoint sharenfs checksum compression atime devices exec setuid readonly zoned snapdir aclmode aclinherit canmount xattr copies version utf8only normalization casesensitivity vscan nbmand sharesmb refquota refreservation primarycache secondarycache usedbysnapshots usedbydataset usedbychildren usedbyrefreservation logbias dedup mlslabel sync refcompressratio written
raptor10k-RAID10/1TB_speed_avail 1.02T
raptor10k-RAID10/1TB_speed_compression off
raptor10k-RAID10/1TB_speed_dedup off
raptor10k-RAID10/1TB_speed_mountpoint /raptor10k-RAID10/1TB_speed
raptor10k-RAID10/1TB_speed_nbmand on
raptor10k-RAID10/1TB_speed_quota none
raptor10k-RAID10/1TB_speed_readonly off
raptor10k-RAID10/1TB_speed_refquota none
raptor10k-RAID10/1TB_speed_refreservation none
raptor10k-RAID10/1TB_speed_reservation none
raptor10k-RAID10/1TB_speed_sharenfs rw
raptor10k-RAID10/1TB_speed_sharesmb name=1TB_speed,guestok=true
raptor10k-RAID10/1TB_speed_sync standard
raptor10k-RAID10/1TB_speed_used 3.25G
raptor10k-RAID10/VMware_avail 1.02T
raptor10k-RAID10/VMware_compression on
raptor10k-RAID10/VMware_dedup off
raptor10k-RAID10/VMware_mountpoint /raptor10k-RAID10/VMware
raptor10k-RAID10/VMware_nbmand on
raptor10k-RAID10/VMware_quota none
raptor10k-RAID10/VMware_readonly off
raptor10k-RAID10/VMware_refquota none
raptor10k-RAID10/VMware_refreservation none
raptor10k-RAID10/VMware_reservation none
raptor10k-RAID10/VMware_sharenfs rw=root=@192.168.3.0/24192.168.2.0/24
raptor10k-RAID10/VMware_sharesmb name=VMware,guestok=true
raptor10k-RAID10/VMware_sync standard
raptor10k-RAID10/VMware_used 15.6G
raptor10k-RAID10_avail 1.05T
raptor10k-RAID10_compression off
raptor10k-RAID10_dedup off
raptor10k-RAID10_mountpoint /raptor10k-RAID10
raptor10k-RAID10_nbmand off
raptor10k-RAID10_quota none
raptor10k-RAID10_readonly off
raptor10k-RAID10_refquota none
raptor10k-RAID10_refreservation 27.4G
raptor10k-RAID10_reservation none
raptor10k-RAID10_sharenfs off
raptor10k-RAID10_sharesmb off
raptor10k-RAID10_sync standard
raptor10k-RAID10_used 46.3G
syspool rpool
------------------------------------------------------------------------------------
smart info
------------------------------------------------------------------------------------
- with Smartinfo if available (works mostly only with SAS Controller)
id diskcap pool vdev state error smart_model smart_type smart_health temp smart_sn smart_check
c4t5000C50046F1A085d0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 ST2000DL003-9VT166 sat,12 PASSED 27 °C 6YD234N1 short long abort log
c4t5000C50046F2D8C1d0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 ST2000DL003-9VT166 sat,12 PASSED 29 °C 6YD2434J short long abort log
c4t5000CCA221D3C439d0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 Hitachi HDS722020ALA330 sat,12 PASSED 34 °C JK1130YAHDGZNT short long abort log
c4t5000CCA221D3CAAEd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 Hitachi HDS722020ALA330 sat,12 PASSED 34 °C JK1130YAHDJPZT short long abort log
c4t50014EE6007472CCd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 WDC WD20EARS-00MVWB0 sat,12 PASSED 32 °C WDWMAZA1193578 short long abort log
c4t50014EE655C9C2DCd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 WDC WD20EARS-00MVWB0 sat,12 PASSED 27 °C WDWMAZA0979429 short long abort log
c4t50024E90044F3EDCd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 SAMSUNG HD204UI sat,12 PASSED 28 °C S2H7JD6ZB00622 short long abort log
c4t50024E90044F3FAEd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 SAMSUNG HD204UI sat,12 PASSED 26 °C S2H7JD6ZB00624 short long abort log
c6t0d0 32.2 GB rpool basic ONLINE S:0 H:0 T:0 - disk n.a. - n.a. short long abort log
c7t14d0 300 GB raptor10k-RAID10 mirror ONLINE S:4 H:0 T:0 WL300GLSA16100 sat,12 PASSED 35 °C LP007105 short long abort log
c7t15d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP007072 short long abort log
c7t16d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP018886 short long abort log
c7t17d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP018961 short long abort log
c7t18d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 35 °C LP009085 short long abort log
c7t19d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 33 °C LP018960 short long abort log
c7t20d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP004010 short long abort log
c7t21d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 33 °C LP009633 short long abort log
-------------------------------------------------------------------------------------
pools
-------------------------------------------------------------------------------------
Pool Version Pool GUID Vdev Ashift Asize Vdev GUID Disk Disk-GUID Cap Product/ Phys_Path/ Dev_Id/ Sn
RAIDz2 5000 2820520080993930436 vdevs: 1
vdev 1: raidz2 12 16.00 TB 5251948501379730193
c4t5000C50046F1A085d0 12333019810253413747 ST2000DL003-9VT1
/scsi_vhci/disk@g5000c50046f1a085:a
id1,sd@n5000c50046f1a085/a
6YD234N1
c4t5000C50046F2D8C1d0 17912313812557223752 ST2000DL003-9VT1
/scsi_vhci/disk@g5000c50046f2d8c1:a
id1,sd@n5000c50046f2d8c1/a
6YD2434J
c4t5000CCA221D3C439d0 3473539919622518624 Hitachi HDS72202
/scsi_vhci/disk@g5000cca221d3c439:a
id1,sd@n5000cca221d3c439/a
JK1130YAHDGZNT
c4t5000CCA221D3CAAEd0 4809642699822734449 Hitachi HDS72202
/scsi_vhci/disk@g5000cca221d3caae:a
id1,sd@n5000cca221d3caae/a
JK1130YAHDJPZT
c4t50014EE6007472CCd0 8577672279742323929 WDC WD20EARS-00M
/scsi_vhci/disk@g50014ee6007472cc:a
id1,sd@n50014ee6007472cc/a
WDWMAZA1193578
c4t50014EE655C9C2DCd0 16491910523771943534 WDC WD20EARS-00M
/scsi_vhci/disk@g50014ee655c9c2dc:a
id1,sd@n50014ee655c9c2dc/a
WDWMAZA0979429
c4t50024E90044F3EDCd0 11274540183612232788 SAMSUNG HD204UI
/scsi_vhci/disk@g50024e90044f3edc:a
id1,sd@n50024e90044f3edc/a
S2H7JD6ZB00622
c4t50024E90044F3FAEd0 1758903232926313746 SAMSUNG HD204UI
/scsi_vhci/disk@g50024e90044f3fae:a
id1,sd@n50024e90044f3fae/a
S2H7JD6ZB00624
raptor10k-RAID10 5000 7473019991373255881 vdevs: 4
vdev 1: mirror 9 300.06 GB 17862662818173334383
c7t14d0 8276855192894438065 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@e,0:a
id1,sd@n50014eef00566ba7/a
LP007105
c7t15d0 4862475159679432941 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@f,0:a
id1,sd@n50014ee0009abc00/a
LP007072
vdev 2: mirror 9 300.06 GB 15603671657220422076
c7t16d0 5131963312324972714 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@10,0:a
id1,sd@n50014ee0ab454531/a
LP018886
c7t17d0 11290850630156887335 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@11,0:a
id1,sd@n50014ee055efdd97/a
LP018961
vdev 3: mirror 9 300.06 GB 17779323401607039181
c7t18d0 13837708582704390866 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@12,0:a
id1,sd@f008a434b5168cd0300028a560001/a
LP009085
c7t19d0 1366491286675847134 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@13,0:a
id1,sd@n50014eef00aaed43/a
LP018960
vdev 4: mirror 9 300.06 GB 11482444555854192767
c7t20d0 5359622763800542043 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@14,0:a
id1,sd@n50014eef00566e28/a
LP004010
c7t21d0 14346063480124713428 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@15,0:a
id1,sd@n50014ee00098c5c5/a
LP009633
rpool 5000 14014268098405055842 vdevs: 1
vdev 1: disk 9 32.17 GB 1904727143742154576
c6t0d0 Virtual disk
/pci@0,0/pci15ad,1976@10/sd@0,0:a
id1,sd@n6000c290cff5bd35738d6f5b52a53dc0/a
6000C290CFF5BD3
------------------------------------------------------------------------
DD Bench on RAIDz2
------------------------------------------------------------------------
Test pool
Blocksize (default 2M)
Count (default: 8192)
You should wait about 40s for correct values
Wait in s between write and read test
Size of Testfile: 16.777216 GB
Memory size: 8192 Megabytes
write 16.777216 GB via dd, please wait...
time dd if=/dev/zero of=/RAIDz2/dd.tst bs=2048000 count=8192
8192+0 records in
8192+0 records out
real 34.9
user 0.0
sys 9.4
16.777216 GB in 34.9s = 480.72 MB/s Write
wait 40 s
read 16.777216 GB via dd, please wait...
time dd if=/RAIDz2/dd.tst of=/dev/null bs=2048000
8192+0 records in
8192+0 records out
real 25.9
user 0.0
sys 8.4
16.777216 GB in 25.9s = 647.77 MB/s Read
-----------------------------------------------------------------------
DD Bench on raptor10k-RAID10
-----------------------------------------------------------------------
Test Pool
Blocksize (default 2M)
Count (default: 8192)
You should wait about 40s for correct values
Wait in s between write and read test
Size of Testfile: 16.777216 GB
Memory size: 8192 Megabytes
write 16.777216 GB via dd, please wait...
time dd if=/dev/zero of=/raptor10k-RAID10/dd.tst bs=2048000 count=8192
8192+0 records in
8192+0 records out
real 39.1
user 0.0
sys 8.5
16.777216 GB in 39.1s = 429.08 MB/s Write
wait 40 s
read 16.777216 GB via dd, please wait...
time dd if=/raptor10k-RAID10/dd.tst of=/dev/null bs=2048000
8192+0 records in
8192+0 records out
real 26.0
user 0.0
sys 7.5
16.777216 GB in 26s = 645.28 MB/s Read
Spec:
Supermicro X8DTE-F dual CPU MB with 7 8x PCI-E slots and 12 RAM slots
2x L5520 Xeon 2.4GHZ Quad Core / HyperThreaded 16 threads total
24GB RDIMM (another 24GB on the way and it will be full up with 48GB next week)
1 LSI 3081E-R 8 port 3gb SAS
1 M1015 8 port 6gb SAS (in IT mode)
8 10k RPM 300GB Raptor 2.5" drives in RAID10
8 2TB drives (mixed) in RAIDz2 (not hung up on this, will do RAID10 if needed)
2 port DDR infiniband for 10Gb/s networking
I'm seeing 170-200MB/s on VMs (NFS) on the RAID10 pool, 250-300MB/s copy's between RAM/SSD to the same pool using SMB. I'm seeing roughly similar speeds on file copies to the RAIDz2 pool using SMB. DD bench is showing 400-450MB/s writes and 600-650MB/s reads on both pools but I could be doing something wrong with it. Just wanting to make sure set it up correctly.
Here is my ZFS outputs from Napp-it. Let me know if you need to see anything else:
https://dl.dropboxusercontent.com/u/10627065/ZFS_server_stats.txt
ZFSinfos hash zfs:
RAIDz2/10TB_RAIDZ2_avail 9.13T
RAIDz2/10TB_RAIDZ2_compression off
RAIDz2/10TB_RAIDZ2_dedup off
RAIDz2/10TB_RAIDZ2_mountpoint /RAIDz2/10TB_RAIDZ2
RAIDz2/10TB_RAIDZ2_nbmand on
RAIDz2/10TB_RAIDZ2_quota none
RAIDz2/10TB_RAIDZ2_readonly off
RAIDz2/10TB_RAIDZ2_refquota none
RAIDz2/10TB_RAIDZ2_refreservation none
RAIDz2/10TB_RAIDZ2_reservation none
RAIDz2/10TB_RAIDZ2_sharenfs rw
RAIDz2/10TB_RAIDZ2_sharesmb name=10TB_RAIDZ2,guestok=true
RAIDz2/10TB_RAIDZ2_sync standard
RAIDz2/10TB_RAIDZ2_used 7.73G
RAIDz2/Business_avail 9.13T
RAIDz2/Business_compression on
RAIDz2/Business_dedup off
RAIDz2/Business_mountpoint /RAIDz2/Business
RAIDz2/Business_nbmand on
RAIDz2/Business_quota none
RAIDz2/Business_readonly off
RAIDz2/Business_refquota none
RAIDz2/Business_refreservation none
RAIDz2/Business_reservation none
RAIDz2/Business_sharenfs off
RAIDz2/Business_sharesmb name=Business,guestok=true
RAIDz2/Business_sync standard
RAIDz2/Business_used 341K
RAIDz2/Public_avail 9.13T
RAIDz2/Public_compression on
RAIDz2/Public_dedup off
RAIDz2/Public_mountpoint /RAIDz2/Public
RAIDz2/Public_nbmand on
RAIDz2/Public_quota none
RAIDz2/Public_readonly off
RAIDz2/Public_refquota none
RAIDz2/Public_refreservation none
RAIDz2/Public_reservation none
RAIDz2/Public_sharenfs off
RAIDz2/Public_sharesmb name=Public,guestok=true
RAIDz2/Public_sync standard
RAIDz2/Public_used 341K
RAIDz2/images_avail 9.13T
RAIDz2/images_compression off
RAIDz2/images_dedup off
RAIDz2/images_mountpoint /RAIDz2/images
RAIDz2/images_nbmand on
RAIDz2/images_quota none
RAIDz2/images_readonly off
RAIDz2/images_refquota none
RAIDz2/images_refreservation none
RAIDz2/images_reservation none
RAIDz2/images_sharenfs off
RAIDz2/images_sharesmb name=images,guestok=true
RAIDz2/images_sync standard
RAIDz2/images_used 341K
RAIDz2_avail 10.1T
RAIDz2_compression off
RAIDz2_dedup off
RAIDz2_mountpoint /RAIDz2
RAIDz2_nbmand off
RAIDz2_quota none
RAIDz2_readonly off
RAIDz2_refquota none
RAIDz2_refreservation 1.01T
RAIDz2_reservation none
RAIDz2_sharenfs off
RAIDz2_sharesmb off
RAIDz2_sync standard
RAIDz2_used 1.02T
allfs RAIDz2 RAIDz2/10TB_RAIDZ2 RAIDz2/Business RAIDz2/Public RAIDz2/images raptor10k-RAID10 raptor10k-RAID10/1TB_speed raptor10k-RAID10/VMware
allpools RAIDz2 raptor10k-RAID10 rpool
buffertime 1368820854
datapools RAIDz2 raptor10k-RAID10
properties type creation used available referenced compressratio mounted quota reservation recordsize mountpoint sharenfs checksum compression atime devices exec setuid readonly zoned snapdir aclmode aclinherit canmount xattr copies version utf8only normalization casesensitivity vscan nbmand sharesmb refquota refreservation primarycache secondarycache usedbysnapshots usedbydataset usedbychildren usedbyrefreservation logbias dedup mlslabel sync refcompressratio writtentype creation used available referenced compressratio mounted quota reservation recordsize mountpoint sharenfs checksum compression atime devices exec setuid readonly zoned snapdir aclmode aclinherit canmount xattr copies version utf8only normalization casesensitivity vscan nbmand sharesmb refquota refreservation primarycache secondarycache usedbysnapshots usedbydataset usedbychildren usedbyrefreservation logbias dedup mlslabel sync refcompressratio written
raptor10k-RAID10/1TB_speed_avail 1.02T
raptor10k-RAID10/1TB_speed_compression off
raptor10k-RAID10/1TB_speed_dedup off
raptor10k-RAID10/1TB_speed_mountpoint /raptor10k-RAID10/1TB_speed
raptor10k-RAID10/1TB_speed_nbmand on
raptor10k-RAID10/1TB_speed_quota none
raptor10k-RAID10/1TB_speed_readonly off
raptor10k-RAID10/1TB_speed_refquota none
raptor10k-RAID10/1TB_speed_refreservation none
raptor10k-RAID10/1TB_speed_reservation none
raptor10k-RAID10/1TB_speed_sharenfs rw
raptor10k-RAID10/1TB_speed_sharesmb name=1TB_speed,guestok=true
raptor10k-RAID10/1TB_speed_sync standard
raptor10k-RAID10/1TB_speed_used 3.25G
raptor10k-RAID10/VMware_avail 1.02T
raptor10k-RAID10/VMware_compression on
raptor10k-RAID10/VMware_dedup off
raptor10k-RAID10/VMware_mountpoint /raptor10k-RAID10/VMware
raptor10k-RAID10/VMware_nbmand on
raptor10k-RAID10/VMware_quota none
raptor10k-RAID10/VMware_readonly off
raptor10k-RAID10/VMware_refquota none
raptor10k-RAID10/VMware_refreservation none
raptor10k-RAID10/VMware_reservation none
raptor10k-RAID10/VMware_sharenfs rw=root=@192.168.3.0/24192.168.2.0/24
raptor10k-RAID10/VMware_sharesmb name=VMware,guestok=true
raptor10k-RAID10/VMware_sync standard
raptor10k-RAID10/VMware_used 15.6G
raptor10k-RAID10_avail 1.05T
raptor10k-RAID10_compression off
raptor10k-RAID10_dedup off
raptor10k-RAID10_mountpoint /raptor10k-RAID10
raptor10k-RAID10_nbmand off
raptor10k-RAID10_quota none
raptor10k-RAID10_readonly off
raptor10k-RAID10_refquota none
raptor10k-RAID10_refreservation 27.4G
raptor10k-RAID10_reservation none
raptor10k-RAID10_sharenfs off
raptor10k-RAID10_sharesmb off
raptor10k-RAID10_sync standard
raptor10k-RAID10_used 46.3G
syspool rpool
------------------------------------------------------------------------------------
smart info
------------------------------------------------------------------------------------
- with Smartinfo if available (works mostly only with SAS Controller)
id diskcap pool vdev state error smart_model smart_type smart_health temp smart_sn smart_check
c4t5000C50046F1A085d0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 ST2000DL003-9VT166 sat,12 PASSED 27 °C 6YD234N1 short long abort log
c4t5000C50046F2D8C1d0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 ST2000DL003-9VT166 sat,12 PASSED 29 °C 6YD2434J short long abort log
c4t5000CCA221D3C439d0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 Hitachi HDS722020ALA330 sat,12 PASSED 34 °C JK1130YAHDGZNT short long abort log
c4t5000CCA221D3CAAEd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 Hitachi HDS722020ALA330 sat,12 PASSED 34 °C JK1130YAHDJPZT short long abort log
c4t50014EE6007472CCd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 WDC WD20EARS-00MVWB0 sat,12 PASSED 32 °C WDWMAZA1193578 short long abort log
c4t50014EE655C9C2DCd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 WDC WD20EARS-00MVWB0 sat,12 PASSED 27 °C WDWMAZA0979429 short long abort log
c4t50024E90044F3EDCd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 SAMSUNG HD204UI sat,12 PASSED 28 °C S2H7JD6ZB00622 short long abort log
c4t50024E90044F3FAEd0 2000 GB RAIDz2 raidz ONLINE S:3 H:0 T:0 SAMSUNG HD204UI sat,12 PASSED 26 °C S2H7JD6ZB00624 short long abort log
c6t0d0 32.2 GB rpool basic ONLINE S:0 H:0 T:0 - disk n.a. - n.a. short long abort log
c7t14d0 300 GB raptor10k-RAID10 mirror ONLINE S:4 H:0 T:0 WL300GLSA16100 sat,12 PASSED 35 °C LP007105 short long abort log
c7t15d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP007072 short long abort log
c7t16d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP018886 short long abort log
c7t17d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP018961 short long abort log
c7t18d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 35 °C LP009085 short long abort log
c7t19d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 33 °C LP018960 short long abort log
c7t20d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 34 °C LP004010 short long abort log
c7t21d0 300 GB raptor10k-RAID10 mirror ONLINE S:3 H:0 T:0 WL300GLSA16100 sat,12 PASSED 33 °C LP009633 short long abort log
-------------------------------------------------------------------------------------
pools
-------------------------------------------------------------------------------------
Pool Version Pool GUID Vdev Ashift Asize Vdev GUID Disk Disk-GUID Cap Product/ Phys_Path/ Dev_Id/ Sn
RAIDz2 5000 2820520080993930436 vdevs: 1
vdev 1: raidz2 12 16.00 TB 5251948501379730193
c4t5000C50046F1A085d0 12333019810253413747 ST2000DL003-9VT1
/scsi_vhci/disk@g5000c50046f1a085:a
id1,sd@n5000c50046f1a085/a
6YD234N1
c4t5000C50046F2D8C1d0 17912313812557223752 ST2000DL003-9VT1
/scsi_vhci/disk@g5000c50046f2d8c1:a
id1,sd@n5000c50046f2d8c1/a
6YD2434J
c4t5000CCA221D3C439d0 3473539919622518624 Hitachi HDS72202
/scsi_vhci/disk@g5000cca221d3c439:a
id1,sd@n5000cca221d3c439/a
JK1130YAHDGZNT
c4t5000CCA221D3CAAEd0 4809642699822734449 Hitachi HDS72202
/scsi_vhci/disk@g5000cca221d3caae:a
id1,sd@n5000cca221d3caae/a
JK1130YAHDJPZT
c4t50014EE6007472CCd0 8577672279742323929 WDC WD20EARS-00M
/scsi_vhci/disk@g50014ee6007472cc:a
id1,sd@n50014ee6007472cc/a
WDWMAZA1193578
c4t50014EE655C9C2DCd0 16491910523771943534 WDC WD20EARS-00M
/scsi_vhci/disk@g50014ee655c9c2dc:a
id1,sd@n50014ee655c9c2dc/a
WDWMAZA0979429
c4t50024E90044F3EDCd0 11274540183612232788 SAMSUNG HD204UI
/scsi_vhci/disk@g50024e90044f3edc:a
id1,sd@n50024e90044f3edc/a
S2H7JD6ZB00622
c4t50024E90044F3FAEd0 1758903232926313746 SAMSUNG HD204UI
/scsi_vhci/disk@g50024e90044f3fae:a
id1,sd@n50024e90044f3fae/a
S2H7JD6ZB00624
raptor10k-RAID10 5000 7473019991373255881 vdevs: 4
vdev 1: mirror 9 300.06 GB 17862662818173334383
c7t14d0 8276855192894438065 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@e,0:a
id1,sd@n50014eef00566ba7/a
LP007105
c7t15d0 4862475159679432941 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@f,0:a
id1,sd@n50014ee0009abc00/a
LP007072
vdev 2: mirror 9 300.06 GB 15603671657220422076
c7t16d0 5131963312324972714 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@10,0:a
id1,sd@n50014ee0ab454531/a
LP018886
c7t17d0 11290850630156887335 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@11,0:a
id1,sd@n50014ee055efdd97/a
LP018961
vdev 3: mirror 9 300.06 GB 17779323401607039181
c7t18d0 13837708582704390866 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@12,0:a
id1,sd@f008a434b5168cd0300028a560001/a
LP009085
c7t19d0 1366491286675847134 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@13,0:a
id1,sd@n50014eef00aaed43/a
LP018960
vdev 4: mirror 9 300.06 GB 11482444555854192767
c7t20d0 5359622763800542043 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@14,0:a
id1,sd@n50014eef00566e28/a
LP004010
c7t21d0 14346063480124713428 WL300GLSA16100
/pci@0,0/pci15ad,7a0@16/pci1000,3140@0/sd@15,0:a
id1,sd@n50014ee00098c5c5/a
LP009633
rpool 5000 14014268098405055842 vdevs: 1
vdev 1: disk 9 32.17 GB 1904727143742154576
c6t0d0 Virtual disk
/pci@0,0/pci15ad,1976@10/sd@0,0:a
id1,sd@n6000c290cff5bd35738d6f5b52a53dc0/a
6000C290CFF5BD3
------------------------------------------------------------------------
DD Bench on RAIDz2
------------------------------------------------------------------------
Test pool
Blocksize (default 2M)
Count (default: 8192)
You should wait about 40s for correct values
Wait in s between write and read test
Size of Testfile: 16.777216 GB
Memory size: 8192 Megabytes
write 16.777216 GB via dd, please wait...
time dd if=/dev/zero of=/RAIDz2/dd.tst bs=2048000 count=8192
8192+0 records in
8192+0 records out
real 34.9
user 0.0
sys 9.4
16.777216 GB in 34.9s = 480.72 MB/s Write
wait 40 s
read 16.777216 GB via dd, please wait...
time dd if=/RAIDz2/dd.tst of=/dev/null bs=2048000
8192+0 records in
8192+0 records out
real 25.9
user 0.0
sys 8.4
16.777216 GB in 25.9s = 647.77 MB/s Read
-----------------------------------------------------------------------
DD Bench on raptor10k-RAID10
-----------------------------------------------------------------------
Test Pool
Blocksize (default 2M)
Count (default: 8192)
You should wait about 40s for correct values
Wait in s between write and read test
Size of Testfile: 16.777216 GB
Memory size: 8192 Megabytes
write 16.777216 GB via dd, please wait...
time dd if=/dev/zero of=/raptor10k-RAID10/dd.tst bs=2048000 count=8192
8192+0 records in
8192+0 records out
real 39.1
user 0.0
sys 8.5
16.777216 GB in 39.1s = 429.08 MB/s Write
wait 40 s
read 16.777216 GB via dd, please wait...
time dd if=/raptor10k-RAID10/dd.tst of=/dev/null bs=2048000
8192+0 records in
8192+0 records out
real 26.0
user 0.0
sys 7.5
16.777216 GB in 26s = 645.28 MB/s Read