scottmtz

Initial sync on LAN then future syncing over WAN

Recommended Posts

I would like to use the speed of the local gigabit network to one way backup my photography files from one Drobo to another. After the initial sync, can I attach the 2nd Drobo offsite to another computer with the same one way key? Will the sending computer see the already transfered files and leave them, only updating new files, or will it attempt to overwrite?

This is about 4 terabytes of raw files and edits I would like to have a offsite backup of.

Thanks,

Scott

Share this post


Link to post
Share on other sites

That sound like an excellent test, and yes, that is how it should work.

Please do take checksums (eg md5 hashs) of all the files, before and after, on both devices so you can tell us how it goes.

Share this post


Link to post
Share on other sites

I have already done this with a ~2TB media collection. I synced locally first and then moved the drive to a family member's house. It does need to index though.

Share this post


Link to post
Share on other sites

Hmm, when you transported did you take the sync.dat file with you ? I assume not, therefor it reindexed and resync'd.

Were all the files there and undamaged ?

Share this post


Link to post
Share on other sites

Yes, all files were fine. I believe the indexes are part of the installation directory and not the sync folder, which is why I had to re-index.

Share this post


Link to post
Share on other sites

I didn't get very far with the initial indexing and had to start over. I was somewhere in the the 700k of files indexed and BTSync started throwing memory errors. I decided to break down the syncing of two main folders instead. I am currently syncing the first one. It seemed like I should let BTSync index and then sync after the completion of the initial indexing since doing both for such a large amount of files was going extremely slow.

Things I am noticing are about 5% max of my gigabit network per each 12 to 75Mb file or about 1.5MB/s with lan encryption off and TCP on.

In Window 7 Processes, STSync.exe is using about 400k of memory. Is that normal?

Share this post


Link to post
Share on other sites

I tried somthing similar... But I run into problems with the number of files... Windows (and my synology NAS) do both run into memory problems. I seems to me that there is a fundemantal problem that needs solving, when syncing large directory's with huge number of files... So i will keep waiting and hoping, with smaller directory's it works great btw!

Share this post


Link to post
Share on other sites

I would like to use the speed of the local gigabit network to one way backup my photography files from one Drobo to another. After the initial sync, can I attach the 2nd Drobo offsite to another computer with the same one way key? Will the sending computer see the already transfered files and leave them, only updating new files, or will it attempt to overwrite?

This is about 4 terabytes of raw files and edits I would like to have a offsite backup of.

Thanks,

Scott

I'm attempting the same thing with a pair of Drobos. One folder in particular has over 4TB of data. I've noticed that when indexing that folder BT Sync eventually stops and becomes unresponsive. I've started noting at what number of indexed files this happens. Right now, it appears to be stuck at 531,178.

If I kill BT Sync and re-start it, the number of indexed files goes down and appears to count up again.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.