I wanted a storage system that support VAAI and Nexenta CE fit the bill perfectly . This is to be used as shared ISCSI target for 4 ESXi host on a C6100 platform.
The system is built on a supermicro chassis 836 with build in sas2 expander with the following hardware:
X8DTL-iF
24Gb Mem
Intel l5606 CPU
OneConnect 2 port 10Gb CNA in ethernet mode
16 x Hitachi 450Gb 15k Drives
LSI-9211 IT -- (1 port is broken)
1 x WD Raptor 150Gb -- Syspol
The zpool is created with 8x Mirror vdev with no L2ARC or ZIL (was planning to use the other 9211 port to connect a few SSD for this)
Compression=on, Dedup=off, Sync=normal.
I've created 3 x 1TB iscsi ZVOL and 3 ISCSI target with default setting, and connect it to ESXi via software ISCSI, multipath, IOPS =100
I've started migrating all my VM that is currently running on another storage server running windows and starwind, and immediately I noticed something weird.
During SVMOTION i noticed that the transfer speed on the windows box would burst to 100MB for a few sec and then drop to 10MB and it would go up again to 100MB.
It does that until the transfer is complete.
Performance testing using ATTO and IOMETER from a few windows VM shows an amazing read/write performance
Max Throughput 100% read
Random 8K - 70% read
Not sure if that random test shows good result or not, but the sequential definitely shows pretty good numbers.
However a very simple test of copying file from one windows vm to another file server i only got around 100MB speed.
Back when the VM was running on starwind I can get consistently around 200-300MB over 10Gb network.
Before I install nexenta, I've tested that each of the hitachi drive is pushing read/write of 200MB in ATTO.
What do you guys think of the server performance ?? is it normal ?
Does anyone have any suggestion on how to bench raw disk performance on ZFS ?
Any suggestion on how to tune this setup ?
Thanks
The system is built on a supermicro chassis 836 with build in sas2 expander with the following hardware:
X8DTL-iF
24Gb Mem
Intel l5606 CPU
OneConnect 2 port 10Gb CNA in ethernet mode
16 x Hitachi 450Gb 15k Drives
LSI-9211 IT -- (1 port is broken)
1 x WD Raptor 150Gb -- Syspol
The zpool is created with 8x Mirror vdev with no L2ARC or ZIL (was planning to use the other 9211 port to connect a few SSD for this)
Compression=on, Dedup=off, Sync=normal.
I've created 3 x 1TB iscsi ZVOL and 3 ISCSI target with default setting, and connect it to ESXi via software ISCSI, multipath, IOPS =100
I've started migrating all my VM that is currently running on another storage server running windows and starwind, and immediately I noticed something weird.
During SVMOTION i noticed that the transfer speed on the windows box would burst to 100MB for a few sec and then drop to 10MB and it would go up again to 100MB.
It does that until the transfer is complete.
Performance testing using ATTO and IOMETER from a few windows VM shows an amazing read/write performance
Max Throughput 100% read
Random 8K - 70% read
Not sure if that random test shows good result or not, but the sequential definitely shows pretty good numbers.
However a very simple test of copying file from one windows vm to another file server i only got around 100MB speed.
Back when the VM was running on starwind I can get consistently around 200-300MB over 10Gb network.
Before I install nexenta, I've tested that each of the hitachi drive is pushing read/write of 200MB in ATTO.
What do you guys think of the server performance ?? is it normal ?
Does anyone have any suggestion on how to bench raw disk performance on ZFS ?
Any suggestion on how to tune this setup ?
Thanks