SinDromX

Delta Syncing Support

Recommended Posts

Hi, I know the feature wasn't available around a year ago, has it changed?

 

I've ran some tests on my current setup, changing only 1 bit of a file triggers syncing of the whole file.

I'd love to see only a small portion of my file beeing transfered over.

Share this post


Link to post
Share on other sites

Thank you GreatMarko .

So according to this, files greater than 4 MB with be chunked in smaller parts and only the different chunks will be transfered.

But my tests proves me that this is not working :-(

Anyone has a feedback on this? Or call. Anyone test it?

Maybe my setup is incorrect and prevents delta from working, or my test protocol is biased.

Share this post


Link to post
Share on other sites

I have several flac files >50mb that I've changed metadata on since getting my sync set up.  With Synctoy, doing the same thing would trigger a full resync of the file and transfer the whole thing, but with BTSync it completes in a fraction of the time.  I can't definitively prove it, but based on the time that the transfer takes and my internet connection, I'd say that it's transferring nowhere near the full >50mb file. 

Share this post


Link to post
Share on other sites

Thank you piotrnik.

 

I now understand why it didn't work, let me explain:

 

Basically, I'm testing with a linux box and a windows seven pc both running btsync 1.3.93.

I've generated a random file on the Linux box and let btsync do it thing to obtain the same file on both machines.

  • Adding/removing data anywhere in the file triggers a transfer from the added/removed chunk to the end of the file
  • Replacing data anywhere in the file (not adding/removing but replacing data bit by bit) triggers transfering only small parts (the replaced data + probably some chunks around)

At first, I was adding data at the very beginning of the file, so the whole file was transfered.

When adding a few bits at the end of the file or replacing a few bits in the file, only a fraction of the file is transfered (the smallest possible chunk seems to be 32kB).

 

So yeah, btsync definitely does delta transfer, and the chunk size is a multiple of 32kBytes.

Just keep in mind that the chunks are calculated from the beginning of the file, so when adding at the beginning, each chunk of the source will be different from the destination file, so a full file transfer will be triggered.

Same with adding data somewhere in the file, the first chunks will be the same, but the chunk containing your added data and all the following ones will be different, meaning possibily a big transfer depending where you change your data.

Replacing data in the file is ok since only the modified chunks will be transfered.

Adding data at the end of the file is also ok since only the new chunks will be transfered.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.