SOLVED: Anyway to improve the performance of new TrueNAS rig (EPYC 7402P)

[traderjay]

Not enough info about the resolve project. Propably simple one asset 1x playback on timeline shouldn't be choppy if the pool is not heavily fragmented.

I am just testing it with one single 8K Raw clip and the playback is choppy. My projects are not complex.

 

[BoredSysadmin]

What the OP wants is not unreasonable at all. He/she gets enough performance out of the SMB drive to cover 4 times the required bitrate of the video. Yet it is choppy for what is presented as a simple linear read. The magnetic drives obviously have enough linear read performance to theoretically make this work - if it wasn't for the networked drive mechanism, which is screwing things up.

Trying iSCSI is free and might shake things up quite a bit.

I'm not sure what you're smoking, but please share. OP said 8k RAW files. These have a bandwidth of 2 GBytes PER SECOND. 400MBis from Truenas (rust) isn't cut it, even in the best-case scenario.
400MBis may be fine for 4k 30fps 8 bit/4:2:0

 

[traderjay]

I'm not sure what you're smoking, but please share. OP said 8k RAW files. These have a bandwidth of 2 GBytes PER SECOND. 400MBis from Truenas (rust) isn't cut it, even in the best-case scenario.
400MBis may be fine for 4k 30fps 8 bit/4:2:0

Sorry i should be clearer in my first post. My 8K RAW footage is from the Canon R5 mirrorless and the bitrate is only 1700 mbps or around 220MB/s

 

[gea]

Propably a new Open-ZFS patch can help in future
that may double write performance on fast devices?


fio w/12x zvols prior to changes:

Run status group 0 (all jobs):

WRITE: bw=1267MiB/s (1328MB/s), 1267MiB/s-1267MiB/s (1328MB/s-1328MB/s), io=148GiB (159GB), run=120009-120009msec


fio with changes applied:

Run status group 0 (all jobs):

WRITE: bw=2380MiB/s (2495MB/s), 2380MiB/s-2380MiB/s (2495MB/s-2495MB/s), io=279GiB (299GB), run=120007-120007msec


zfs sync parallelism by ednadolski-ix · Pull Request #15197 · openzfs/zfs

 

[jei]

I downloaded Canon R5 8K RAW sample from here: R5 8K 30fps files (Credit to Moc/Hoang Nguyen) - Google Drive

Rate is about 325MB/s

Playback on Resolve timeline over 10Gbit SMB from a degraded (7 of 8 disks online) RAIDZ2 NVME pool is what I'd consider ok. One stutter here or there. Because of the file size it is probably fully cached so only thing limiting is the network.

Local playback from Samsung 990 Pro is a lot more stuttery, which is a bit weird. But like people answered you elsewhere, proxies are probably the best way to deal with 8K files.

 

[traderjay]

I downloaded Canon R5 8K RAW sample from here: R5 8K 30fps files (Credit to Moc/Hoang Nguyen) - Google Drive

Rate is about 325MB/s

Playback on Resolve timeline over 10Gbit SMB from a degraded (7 of 8 disks online) RAIDZ2 NVME pool is what I'd consider ok. One stutter here or there. Because of the file size it is probably fully cached so only thing limiting is the network.

Local playback from Samsung 990 Pro is a lot more stuttery, which is a bit weird. But like people answered you elsewhere, proxies are probably the best way to deal with 8K files.

The R5 has two 8K RAW file type, light and full res. The RAW light bitrate is around 1700mbps. Thanks for your finding and test!

 

[traderjay]

Propably a new Open-ZFS patch can help in future
that may double write performance on fast devices?


fio w/12x zvols prior to changes:

Run status group 0 (all jobs):

WRITE: bw=1267MiB/s (1328MB/s), 1267MiB/s-1267MiB/s (1328MB/s-1328MB/s), io=148GiB (159GB), run=120009-120009msec


fio with changes applied:

Run status group 0 (all jobs):

WRITE: bw=2380MiB/s (2495MB/s), 2380MiB/s-2380MiB/s (2495MB/s-2495MB/s), io=279GiB (299GB), run=120007-120007msec


zfs sync parallelism by ednadolski-ix · Pull Request #15197 · openzfs/zfs

How do I apply this patch to Truenas and any data integrity risks?

 

[gea]

When it is in newest Open-ZFS you have to wait normally until your OS of choice is offering this feature.
One should (on all very new and critical ZFS features) wait a few months to allow others to find and fix possible remaining bugs.....

 

[traderjay]

THANKS all for the suggestions. I solved my issue by creating a 3 x 2(disk) mirror and now I am able to edit and scrub the footage smoothly! Performance went up by ALOT!