Hi, ppl!
I've got a weird situation and would like to ask for help.
I have a number of Samsung sm863 1.92TB SSDs and finally got my servers. Firstly I've tested SSDs on a workstation motherboard with z97 chipset via internal sata3 port. Have got the next results (I've posted these results in Sebastien Han's blog comments):
But now I've tested the same drives with newly arrived Intel H2312JFFKR servers. I've got and installed a 6 gbps SAS option (AH2000JF6GKIT) as well, which includes 6Gbps SAS module RMS25LB. I found and flashed the latest firmware for it.
I can see that SSDs connected at 6 gbps:
But the same tests show totally different results:
Do I miss something? These results are just terrible for such drives and more than 2 times worse than on z97 sata port. Are there any parameters I can tune on rms25lb adapter?
Thanks!
I've got a weird situation and would like to ask for help.
I have a number of Samsung sm863 1.92TB SSDs and finally got my servers. Firstly I've tested SSDs on a workstation motherboard with z97 chipset via internal sata3 port. Have got the next results (I've posted these results in Sebastien Han's blog comments):
Samsung SM863 MZ7KM1T9HAJM-00005 1.92TB - firmware GXM1003Q - fio 2.12
Commands:
hdparm -W 0 /dev/sdc
fio --filename=/dev/sdc --direct=1 --sync=1 --rw=write --bs=4k --numjobs=X --iodepth=1 --runtime=60 --time_based --group_reporting --name=journal-test
1 job:
write: io=9559.9MB, bw=163151KB/s, iops=40787, runt= 60001msec
clat (usec): min=22, max=19940, avg=24.09, stdev=15.52
5 jobs:
write: io=20166MB, bw=344155KB/s, iops=86038, runt= 60001msec
clat (usec): min=23, max=9054, avg=57.56, stdev=18.88
10 jobs:
write: io=20243MB, bw=345477KB/s, iops=86369, runt= 60001msec
clat (usec): min=28, max=19841, avg=115.18, stdev=42.61
Tested on Intel Z97 onboard SATA3 port.
Commands:
hdparm -W 0 /dev/sdc
fio --filename=/dev/sdc --direct=1 --sync=1 --rw=write --bs=4k --numjobs=X --iodepth=1 --runtime=60 --time_based --group_reporting --name=journal-test
1 job:
write: io=9559.9MB, bw=163151KB/s, iops=40787, runt= 60001msec
clat (usec): min=22, max=19940, avg=24.09, stdev=15.52
5 jobs:
write: io=20166MB, bw=344155KB/s, iops=86038, runt= 60001msec
clat (usec): min=23, max=9054, avg=57.56, stdev=18.88
10 jobs:
write: io=20243MB, bw=345477KB/s, iops=86369, runt= 60001msec
clat (usec): min=28, max=19841, avg=115.18, stdev=42.61
Tested on Intel Z97 onboard SATA3 port.
But now I've tested the same drives with newly arrived Intel H2312JFFKR servers. I've got and installed a 6 gbps SAS option (AH2000JF6GKIT) as well, which includes 6Gbps SAS module RMS25LB. I found and flashed the latest firmware for it.
I can see that SSDs connected at 6 gbps:
smartctl 6.5 2016-01-24 r4214 [x86_64-linux-4.10.0-33-generic] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Device Model: SAMSUNG MZ7KM1T9HAJM-00005
Serial Number: S2HNNXxxxxxxxxxx
LU WWN Device Id: 5 002538 c4040827a
Firmware Version: GXM1003Q
User Capacity: 1,920,383,410,176 bytes [1.92 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: Solid State Device
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ACS-2, ATA8-ACS T13/1699-D revision 4c
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Wed Sep 6 15:25:27 2017 +05
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is: Unavailable
APM feature is: Unavailable
Rd look-ahead is: Enabled
Write cache is: Enabled
ATA Security is: Disabled, NOT FROZEN [SEC1]
Wt Cache Reorder: Enabled
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Device Model: SAMSUNG MZ7KM1T9HAJM-00005
Serial Number: S2HNNXxxxxxxxxxx
LU WWN Device Id: 5 002538 c4040827a
Firmware Version: GXM1003Q
User Capacity: 1,920,383,410,176 bytes [1.92 TB]
Sector Size: 512 bytes logical/physical
Rotation Rate: Solid State Device
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ACS-2, ATA8-ACS T13/1699-D revision 4c
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Wed Sep 6 15:25:27 2017 +05
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is: Unavailable
APM feature is: Unavailable
Rd look-ahead is: Enabled
Write cache is: Enabled
ATA Security is: Disabled, NOT FROZEN [SEC1]
Wt Cache Reorder: Enabled
But the same tests show totally different results:
1 job:
write: io=3485.3MB, bw=59481KB/s, iops=14870, runt= 60001msec
clat (usec): min=63, max=1332, avg=66.06, stdev= 4.39
5 jobs:
write: io=7992.3MB, bw=136399KB/s, iops=34099, runt= 60001msec
clat (usec): min=83, max=817, avg=145.25, stdev=12.15
10 jobs:
write: io=9994.8MB, bw=170572KB/s, iops=42642, runt= 60002msec
clat (usec): min=110, max=1227, avg=233.07, stdev=18.05
write: io=3485.3MB, bw=59481KB/s, iops=14870, runt= 60001msec
clat (usec): min=63, max=1332, avg=66.06, stdev= 4.39
5 jobs:
write: io=7992.3MB, bw=136399KB/s, iops=34099, runt= 60001msec
clat (usec): min=83, max=817, avg=145.25, stdev=12.15
10 jobs:
write: io=9994.8MB, bw=170572KB/s, iops=42642, runt= 60002msec
clat (usec): min=110, max=1227, avg=233.07, stdev=18.05
Do I miss something? These results are just terrible for such drives and more than 2 times worse than on z97 sata port. Are there any parameters I can tune on rms25lb adapter?
Thanks!
Last edited: