Recent Hetzner incident should be a lesson. Cloud storage. 2 hdd's in an array failed almost at the same time. 3rd hdd rebuilding failed. Boom. Ceph cluster gone.
Only snaphsots I thought ? No idea what a ceph snapshot is but i thought i was like vmware ones, so backups basically?
I've thought about jury-rigging a fully enclosed rack with a portable AC. This may be a solution if I keep a NAS in the garage. Times like this I'm jealous of a friend who lives in a state where they have basements. Aside from the fact that his basement is essentially a total additional 4 bedroom "home," he has a room dedicated to his homelab in the basement where it is cool year round without needing special cooling.
I'm not familiar with Hetzner as I only have a couple VPS through Afterburst. I know they provide some dedicated server services, but aren't most of their services via auctions of third party-owned servers running on commodity to enterprise grade systems?
But isn't the whole point of Ceph that it is resilient to issues with nodes?It was confirmed by Hetzner that a Ceph-cluster with snapshots of customers cloud storage went bust. Ok, snapshots only. Pure luck. They have to the same setup for the customer cloud storage. So same could have happened there.
Even worse. Snapshots of the customers cloud storage in the same DC
-8e HBA and add disk shelves as needed. Don't get too fancy with storage, lest you make a mistake and either kill your array or leave it not as redundant as you thought it was.Yes I've still got the physical discs, which is why I'm not too concerned about backups at the moment per se. The last time I checked, the discs are still in good condition, but I wouldn't count on it let's say 10-15 years from now.
I intended to ask for a general "idea" discussion, and it immediately escalated to clusters lol.how did we go from an 8bay synnology nas to a cluster?
No problem at all. I think clusters are the future. I've always been interested in clusters ever since I built a Beowulf cluster back in the day. I've been following Ceph for a while, and recently have been reading about GlusterFS. Whether it is appropriate for homelabs is a question as is the cost. I've seen a lot of discussion about Ceph, but it seems like a lot of homelabbers are running quite small Ceph clusters on old hardware "just because." While I am all in for doing fun things like that, the constraint for me is I'm not willing to do that for a long term system. For example, if my hard disk budget is $5,000 or $10,000, with another $3,000 for a server, I probably would not go with a solution I'm not confident in adminning.
but somehow didn't get fired because I fixed and learned from it. Broke the thing, fixed the thing, and wrote the DR on the broken thing Cluster support in the future for TrueNAS is supposed to be able to be set up via the GUI though, is my understanding. iX continues to state it isn't appropriate for production systems so I do believe guidance from the source carries some weight.
Hah, I have subs to Netflix, Disney+, HBO Max, Paramount+, and the SO always complains there’s “nothing to watch,” ofc right before discovering a series and binging it. The Plex is mainly for movies from my physical library.I use Windows + snapraid + drivepool. The great thing about this approach is that you are using a native OS file system; which potentially means that recovery is easier / at least partial recovery from some catastrophic failure conditions. It fits a media use case quite well - incremental changes to files. I use a 12 drive approach (10 data + 2 parity).
The biggest issue is what you alluded to in the original post- unless you delete data you will always at some point run out of space; irrespective of how you order it. You could look at x265 codec to reduce space.
Depending what you actually store / watch, its probably cheaper just to take out all the tv subscription packages in your locale. But where would the fun be in that
Ah, I was under the possibly wrong impression that there was a difference between a disk shelf and a DIY JBOD chassis, though the end result is the same.
May I ask what reservations you have regarding SnapRAID when store 'big' streaming media, like video files?
Maybe there’s an odd disconnect on my end because on one hand I stated at this point I don’t mind re-ripping (thus not caring about bulletproof data integrity atm), while also wanting to design for a more data-secure system. I’d like to clarify what I’m thinking along the lines of. SnapRAID is a great solution but IMHO I’d rather keep longer term data storage on a RAID/RAID-like storage system. I do use SnapRAID for temporary/transient data before moving it to longer term storage.
I understand perfectly the 'disconnect' as I am myself going back and forth in reasoning if I should migrate my data to Z-RAID. SnapRAID has served me very well but something gnaws in me knowing there is a bit here and there that might flip eventually..
There are a lot of people who are sufficiently invested into some distro’s fan base on Reddit and various forums who claim bitrot doesn’t exist. It absolutely does, though tbf in the last 30 years I’ve encountered exactly *4* instances of minor bitrot. I think it all comes down to how much that particular data is valued. For personal files such as family pictures/video, I put on ZFS hands down. There, even minor bitrot may be devastating. For less valued stuff that’s replaceable I’m perfectly fine with regular non-ZFS soft RAID or SnapRAID.