Background:
I'm looking to build a media ingestion PC for ripping all my 1080p and "4K" blu-rays to get them online. Something like 10 UHD friendly optical drives in a single tower for ripping 10 discs in parallel. I plan to put the resulting files on another server utilizing ZFS (not built yet). My understanding is that ZFS can't be defragmented and "streaming" 10 large files of unknown size (until they're done ripping) in the 30-90GB range in parallel over 10gig ethernet to the server running ZFS is basically guaranteed to fragment them.
My initial idea to avoid this fragmentation is to write the 10 files locally in parallel to a large SSD, (like ~4TB) and then dump the contents of the SSD to the server (with ZFS) sequentially so the files will not get fragmented in the ZFS pool. Saturating 10gig ethernet rules out SATA. I'd don't have SAS in that system, so it's out (unless a SAS controller + SAS SSD a good bit cheaper). I think that leaves me with a PCIe connected SSD. I see I can get any number of different enterprise new and used 2.5" NVMe U.2 SSD's in the 3.84-4.0TB size range that have something like 5+PB of endurance for around $275-350'ish. I'm thinking ~4TB because 10 drives ripping 100GB 3 layer "4K" blu-rays in parallel can generate about 1TB per hour. 4TB can be several hours worth of ripping.
I'm looking at drives like these:
(new)
(used)
I've been avoiding used drive drive listings that don't give any indication of the drive's health (endurance remaining). I'm also not so interested in drives that are power hogs. I have ~120TB of Blu-rays to rip so the multiple PB of endurance isn't strictly necessary, but it would be nice to be able to use the drive for something else once this process is done.
Is there another cheaper way to handle this that I'm overlooking (other than ripping 1 at a time)?
Are there any suggestions for a specific PCIe connected SSD model?
I'm looking to build a media ingestion PC for ripping all my 1080p and "4K" blu-rays to get them online. Something like 10 UHD friendly optical drives in a single tower for ripping 10 discs in parallel. I plan to put the resulting files on another server utilizing ZFS (not built yet). My understanding is that ZFS can't be defragmented and "streaming" 10 large files of unknown size (until they're done ripping) in the 30-90GB range in parallel over 10gig ethernet to the server running ZFS is basically guaranteed to fragment them.
My initial idea to avoid this fragmentation is to write the 10 files locally in parallel to a large SSD, (like ~4TB) and then dump the contents of the SSD to the server (with ZFS) sequentially so the files will not get fragmented in the ZFS pool. Saturating 10gig ethernet rules out SATA. I'd don't have SAS in that system, so it's out (unless a SAS controller + SAS SSD a good bit cheaper). I think that leaves me with a PCIe connected SSD. I see I can get any number of different enterprise new and used 2.5" NVMe U.2 SSD's in the 3.84-4.0TB size range that have something like 5+PB of endurance for around $275-350'ish. I'm thinking ~4TB because 10 drives ripping 100GB 3 layer "4K" blu-rays in parallel can generate about 1TB per hour. 4TB can be several hours worth of ripping.
I'm looking at drives like these:
(new)
SK Hynix HP HFS3T8GDUFEH-A430A 3.84TB PCIe NVME 2.5 U.2 SSD P11534-003 | eBay
Find many great new & used options and get the best deals for SK Hynix HP HFS3T8GDUFEH-A430A 3.84TB PCIe NVME 2.5 U.2 SSD P11534-003 at the best online prices at eBay! Free shipping for many products!
www.ebay.com
WD SN630 WUS3BA138C7P3E3 0TS1755 0TS1619 3.84TB U.2 PCIe 3.1 NVMe SSD 783555225851 | eBay
Find many great new & used options and get the best deals for WD SN630 WUS3BA138C7P3E3 0TS1755 0TS1619 3.84TB U.2 PCIe 3.1 NVMe SSD at the best online prices at eBay! Free shipping for many products!
www.ebay.com
(used)
3.84TB Samsung SSD U.2 MZQLB7T7HALS-00007 PM983 2.5" Nvme Gen3.0 x4 MZQLB3T80 | eBay
Find many great new & used options and get the best deals for 3.84TB Samsung SSD U.2 MZQLB7T7HALS-00007 PM983 2.5" Nvme Gen3.0 x4 MZQLB3T80 at the best online prices at eBay! Free shipping for many products!
www.ebay.com
INTEL SSDPE2KX040T8 4TB 2.5 U.2 P4510 INTEL NVME SSD | eBay
Find many great new & used options and get the best deals for INTEL SSDPE2KX040T8 4TB 2.5 U.2 P4510 INTEL NVME SSD at the best online prices at eBay! Free shipping for many products!
www.ebay.com
I've been avoiding used drive drive listings that don't give any indication of the drive's health (endurance remaining). I'm also not so interested in drives that are power hogs. I have ~120TB of Blu-rays to rip so the multiple PB of endurance isn't strictly necessary, but it would be nice to be able to use the drive for something else once this process is done.
Is there another cheaper way to handle this that I'm overlooking (other than ripping 1 at a time)?
Are there any suggestions for a specific PCIe connected SSD model?