Off site 2 way sync, dissimilar OS

Discussion in 'Software Stuff' started by 33_viper_33, Jan 11, 2020.

  1. 33_viper_33

    33_viper_33 Member

    Joined:
    Aug 3, 2013
    Messages:
    196
    Likes Received:
    2
    Hi guys,

    I'm trying to identify a good method of conducting a 2 way sync between a ZFS (OmiOS) array and a remote windows owned hardware array. Both have nfs and samba shares. The arays are around 20TB in size with 16TB utilization. Please don't tell me to switch the hardware windows machine to ZFS. I want to, but the owner doesn't trust software raid and is a windows fanatic.

    I'd use rsync, but I've had problems with 2 way syncing historically. I'm also not sure that method would work with windows.

    I thought about a windows application like goodsync, but I suspect that method would take enormous amount of time over our office network.

    I'm now considering a solution like owncloud, but I don't know the extent of it's syncing ability since I've never used it. I may be extremely off made here, but the web access is attractive if it provides the syncing capabilities.

    What else should I research?

    -V
     
    #1
  2. fossxplorer

    fossxplorer Active Member

    Joined:
    Mar 17, 2016
    Messages:
    426
    Likes Received:
    49
    ownCloud and Nextcloud don't do delta sync which is quite significant for remote sync. Also it is WebDAV based and can be slow in many scenarios where you sync a lot of data. Seafile might be better if you go for such solution, but both bring the complexity of maintaining DB, web server etc.

    What about Unison File Synchronizer
     
    #2
  3. PigLover

    PigLover Moderator

    Joined:
    Jan 26, 2011
    Messages:
    2,783
    Likes Received:
    1,122
    There are pretty good sync tools for Windows that would work. I use GoodSync to sync from a Windows server to a samba share on Linux. It’s pretty flexible and can sync to many targets (including S3 and other cloud targets).

    it’s commercial, it the license is pretty cheap for ‘non server’ hosts.
     
    #3
  4. azev

    azev Active Member

    Joined:
    Jan 18, 2013
    Messages:
    647
    Likes Received:
    164
    I've used syncthing to synchronize a few folder between windows and linux box and it works great.
     
    #4
    vudu likes this.
  5. cageek

    cageek New Member

    Joined:
    Jun 22, 2018
    Messages:
    8
    Likes Received:
    1
    You can use rclone as an rsync replacement with a lot of cloud storage solutions. I haven't ever used it for a 2-way sync.
     
    #5
  6. j_h_o

    j_h_o Active Member

    Joined:
    Apr 21, 2015
    Messages:
    380
    Likes Received:
    76
    +1 for syncthing. I use this in basically an identical scenario. You can then enable additional snapshotting at the remote end to achieve a point-in-time backup.

    Make sure you set up some monitoring for syncthing to ensure the sync is running/enabled.
     
    #6
    vudu likes this.
  7. vudu

    vudu Member

    Joined:
    Dec 30, 2017
    Messages:
    34
    Likes Received:
    7
    +1 Syncthing with snapshotting as per j_h_o
     
    #7
  8. zack$

    zack$ Active Member

    Joined:
    Aug 16, 2018
    Messages:
    234
    Likes Received:
    86
    syncthing: open source, secure, multi-platform support.

    edit: forgot to mention, I agree with those before me on this :)
     
    #8
Similar Threads: site sync
Forum Title Date
Software Stuff Hardware Tech Sites - Yikes on HTTPS and Cookies Sep 25, 2016
Software Stuff Nice site by one of the STH community May 14, 2016
Software Stuff 162k wordpress sites used in DDoS attack Mar 12, 2014
Software Stuff Ceph gets asynchronous io (or a write back mode) in kernel 4.5 Mar 14, 2016
Software Stuff rsync debate - what to do Feb 8, 2015

Share This Page