HOT HGST HUSMM8040's for $99, qty avail.

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

kapone

Well-Known Member
May 23, 2015
1,095
642
113
No tuning. This was just me popping them in to see if things are working/connecting, the way they should.
 

Aestr

Well-Known Member
Oct 22, 2014
967
386
63
Seattle
I think @Boddy is from Australia, or at least not America so he probably can't see any listings as the seller won't ship there.
 

Boddy

Active Member
Oct 25, 2014
772
144
43
Sorry, all. @BLinux you are correct. I was viewing his store on my cell phone and no items came up.
On my PC I do see items in his store.
 

frogtech

Well-Known Member
Jan 4, 2016
1,482
272
83
35
I have these striped in Server 2016 just to eval the performance and I'm not getting the read performance I would expect based on the spec sheet. 3376 MB/s for 4 drives that claim 1100 MB/s read per drive, so I'd think I'd be seeing 4400 MB/s...any idea what gives? Using an HBA with 3008 chipset. The write is as expected; it's 2800 MB/s which is 700 MB/s advertised x 4.

upload_2018-8-28_0-58-57.png

If I remove them from the stripe and test each individually, I get about the speeds you expect.

1060 MB/s read, 721 MB/s write approximately per device. Guess the Windows striping is not that great?
 
Last edited:

kapone

Well-Known Member
May 23, 2015
1,095
642
113
Is this Windows Disk Management (striping) or Storage Spaces?

Remember, the storage spaces "controller" is essentially a software based "RAID card", however, the device drive code runs in the kernel-ish space, vs Disk Management that runs in user space. That switching back and forth can significant impact on IO, especially at these speeds.

(I could be wrong on this, haven't looked at architecture changes in the latest Windows)
 

frogtech

Well-Known Member
Jan 4, 2016
1,482
272
83
35
It's disk management. Ill do a storage spaces stripe and see if it makes any difference. Regardless they're going to end up in a converged scenario anyway, either VSAN or S2D.
 

PithyChats

Active Member
Feb 3, 2015
173
85
28
I have these striped in Server 2016 just to eval the performance and I'm not getting the read performance I would expect based on the spec sheet. 3376 MB/s for 4 drives that claim 1100 MB/s read per drive, so I'd think I'd be seeing 4400 MB/s...any idea what gives? Using an HBA with 3008 chipset. The write is as expected; it's 2800 MB/s which is 700 MB/s advertised x 4.

View attachment 9181

If I remove them from the stripe and test each individually, I get about the speeds you expect.

1060 MB/s read, 721 MB/s write approximately per device. Guess the Windows striping is not that great?
Have you tried striping just two drives? What slot is the HBA in? You might be running into slot bandwidth limitations.
 

frogtech

Well-Known Member
Jan 4, 2016
1,482
272
83
35
Have you tried striping just two drives? What slot is the HBA in? You might be running into slot bandwidth limitations.
It's in a x16 3.0 slot.

I get slightly better speeds in a Storage Spaces pool in S2016. 3681 MB/s read across 4 devices.

Would be great if someone could test their devices as well.
 
Last edited:

kapone

Well-Known Member
May 23, 2015
1,095
642
113
It's in a x16 3.0 slot.

I get slightly better speeds in a Storage Spaces pool in S2016. 3681 MB/s read across 4 devices.

Would be great if someone could test their devices as well.
I'm seeing approximately the same speeds on a 4 drive RAID-0. I'm using an Adaptec 8885e HBA (12gb/s 16 port native) which has a spec of 6.6GBps max. I can come close to that with a RAID-0 of 8x of these, so with only four of them 3.3GBps seems about right.
 

frogtech

Well-Known Member
Jan 4, 2016
1,482
272
83
35
I guess I'm confused, even at 12 Gb/s, 1100 MB/s read per device is still under spec per lane for SAS3? 4.4 GB read for 4 devices is also still within spec. I checked out some spec sheets, SAS 3008 does 9.6 GB/s full duplex so I'm still at a loss discovering wherein the 3008 chipset is not able to handle 4 devices at line rate in a simple bench.
 

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,625
2,043
113
What about trying to give it some more threads instead of just 1?

Your #s look right to me though, esp using that benchmark tool.

8x SAS3 SSD on 1 HBA will NOT yield best performance either that's too many on 1 HBA.
 

kapone

Well-Known Member
May 23, 2015
1,095
642
113
I guess I'm confused, even at 12 Gb/s, 1100 MB/s read per device is still under spec per lane for SAS3? 4.4 GB read for 4 devices is also still within spec. I checked out some spec sheets, SAS 3008 does 9.6 GB/s full duplex so I'm still at a loss discovering wherein the 3008 chipset is not able to handle 4 devices at line rate in a simple bench.
PCI-E 3.0 theoretical throughput is 8GT/s or ~985MBps per lane, full duplex. SAS 3008 based cards or the Adaptec 12gbps cards are all 8x lane cards.

That equates to ~7.88GBps theoretical throughput on a PCI-E 3.0 8x card. In practice, you'll never reach that speed, it'll be less than that.

I don't see how SAS 3008 can claim 9.6GBps with an 8x card, unless it's not an 8x card.
 

frogtech

Well-Known Member
Jan 4, 2016
1,482
272
83
35
I'm able to push slightly higher, up to around 4051 MB/s with higher queue depth and threads(128 QD, 24 threads), but at a certain point the setting doesn't add any performance. I guess it should be fine, at any rate, for my uses.
 

T_Minus

Build. Break. Fix. Repeat
Feb 15, 2015
7,625
2,043
113
I'm able to push slightly higher, up to around 4051 MB/s with higher queue depth and threads(128 QD, 24 threads), but at a certain point the setting doesn't add any performance. I guess it should be fine, at any rate, for my uses.
Of course that's why I said that benchmark is limited and to up the threads, you're getting what's expected, there is a little more to squeeze out but you're pretty much getting what's expected.

Test with Iometer project if you want to 'max it out' during a benchmark
 

frogtech

Well-Known Member
Jan 4, 2016
1,482
272
83
35
not to revive a dead thread (okay, i'm totally reviving it), but just in case anyone wants to do the transaction via ebay, and didn't see my listing in FS/FT for some reason, I posted my 16 on ebay.

HGST HUSMM8040ASS205 400GB 2.5" SAS3 12 Gbps Enterprise SAS SSD | eBay

these drives have all been tested by me but they would be utilized in a chassis that only goes up to 6 Gbps(available controller limitations and the expander infrastructure of the enclosure would limit their speed for me anyway) so I have no need for them.