Block Level dedupe on Synology BTRFS VS adding more drives

Discussion in 'NAS Systems and Networked Home and SMB Software' started by Mgrobins, Nov 29, 2019.

  1. Mgrobins

    Mgrobins New Member

    Joined:
    Nov 28, 2019
    Messages:
    4
    Likes Received:
    0
    Hi,

    I have a NAS Running Xpenology, Xeon based with BTRFS file system.

    Synology DSM does not natively implement inline or offline deduplication with BTRFS.

    I can however run a VM container using docker and install a package to do offline dedupe.

    My question is, for a server that is majority media - MKV video and music files, how much block level duplication (thus reduction) will I likely see?

    My alternative is simply to add more storage which of course costs money.

    Id be interested in the risks of either approach (I know the risks with RAID 6 but not dedupe) and general comments relevant to the idea :).

    Cheers,
     
    #1
  2. marv

    marv Member

    Joined:
    Apr 2, 2015
    Messages:
    110
    Likes Received:
    22
    Hi, compressed data will have negligible dedupe ratio, its not worth the trouble.
     
    #2
  3. BoredSysadmin

    BoredSysadmin Active Member

    Joined:
    Mar 2, 2019
    Messages:
    281
    Likes Received:
    62
    agree with marv. you won't gain much (if anything) from storage side compression nor dedup on compressed media files.
    Besides deleting files, your other option to extend the current storage for a longer lifespan is to transcode videos to lower resolutions (1080p->720p) and/or HEVC or H.265 video codec - it could deliver 2x compression over it's older H.264 parent.
    Also, depending on your HT system, you probably you won't notice much difference in audio from DTS [or it HD options] to 6 channels AAC.

    /me hides before DataHoarders crowd sees this blasphemy.
     
    #3
    Last edited: Dec 3, 2019

Share This Page