Sync Across A Cluster - Data Transmission Question


dregge8
 Share

Recommended Posts

Scenario, I have SeedBox and would like to sync the contents to 10 different btsync nodes. The SeedBox is the Master, is set for Read-Only and of course, all of content is coming from there. When btsync is transmitting data, would it be sending sequential incremental pieces to all 10 nodes simultaneously, or would it be sending different pieces to each node and they would all work together to fill in the gaps, thus sharing the load.

 

ie. I have a 600mb file being sent to 6 nodes, would it send different chunks to each node, or would it start from scratch on each one?

 

x00000

x00000
0x0000
00x000
000x00
0000x0
00000x

 

or

x00000
x00000
x00000
x00000
x00000

 


 

Link to comment
Share on other sites

When btsync is transmitting data, would it be sending sequential incremental pieces to all 10 nodes simultaneously, or would it be sending different pieces to each node and they would all work together to fill in the gaps, thus sharing the load.

The latter - different chunks of data will be sent to the 10 nodes, and each of these nodes will in turn share those chunks with other nodes.

Link to comment
Share on other sites

The latter - different chunks of data will be sent to the 10 nodes, and each of these nodes will in turn share those chunks with other nodes.

Great, this could work out ideally for me.  Currently I sync from my seedbox using lftp which maxes my bandwidth, however with bittorrent sync and 1 node I only seem to transfer at about 10 mbit because it is only using one connection.  However if I have several nodes, and they are each getting different chunks at 10 mbit and thus sharing the load, all of my connections should max out.

Link to comment
Share on other sites

  • 2 weeks later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

 Share