ZFS iSER SAN

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.

Rand__

Well-Known Member
Mar 6, 2014
6,626
1,767
113
Very nice, dont understand much but looks followable, thanks.

One q- 10 nvme total or per box?
 

efschu2

Member
Feb 14, 2019
68
12
8
There are 10 (dual-ported) u.2 nvmes, which can be accessed from both nodes. I have played around with the raid setup and actually got better results on 3x3 striped raidz + 1 spare, but the performance of raidz2 of 10 disks is way enough for my usecase, so I ended up in going for the higher capacity
 

Rand__

Well-Known Member
Mar 6, 2014
6,626
1,767
113
Ah, ok got it.
Have you per chance run a benchmark with a single disk or mirror pair?

For 8 nvme drives this still seems kind of low, especially at lower blocksizes (compared to theoretical local values)
 

efschu2

Member
Feb 14, 2019
68
12
8
If I compare these results with the ones here (with optanes) on page 51 http://napp-it.org/doc/downloads/optane_slog_pool_performane.pdf I'm quite fine with that.
If I run iometer I can easily reach 100k+ iops, but the performance is limited by my old initiator testmachine.
I will post some results if we have upgraded our "big" esxis to 6.7, right now they are connected via iscsi cus of the lack of iser initiator on esxi6 and CX4.