Inconsistent Speed


crazyk4952

Recommended Posts

crazyk4952,

 

That doesn't look so bad.  Looks like you averaged 464 KB/s.  And for clarity sake... when you said syncing between 2 peers does that mean a sync between 2 computers or 3 computers? 

 

 


Here's a graph of the test transfer i did with 100 3MB files.  This is a three way sync (A is syncing to B and C)

 

 

93KCxfy.jpg

 

 

 

Here's a snapshot of the router page during the above transfer at one of the two computers (the other one is behind a pfSense router/firewall and i couldn't find a similar status page)

 

af4OrGT.png

 

I don't think I'm maxing out the amount of connections.  Would tweaking the UDP timeout settings help?

Link to comment
Share on other sites

  • 3 weeks later...
  • 2 weeks later...
  • 4 weeks later...

Hi,

 

I'm seeing similar issues when syncing large files. Speed goes up to reasonable level, then slows back down to zero, then picks back up again. Sometimes it pauses for some seconds while with "Nothing being transferred right now" in the Transfers tab, possibly before moving onto the next chunk. It's very inefficient as a result.

 

The box sending the files is a Debian 7 64-bit host, reciever is Win 8.

 

Also can you clarify whether Bt Sync uses multiple concurrent connections to transfer single large files? If not, when is this capability expected to be added? It would be a very useful feature for this software to have.

 

Thanks,

Bohdy.

Link to comment
Share on other sites

Hi Roman,

This is over WAN. I haven't had a chance to try it over LAN yet.

And the reason that I ask about multiple connections for large files is to do with the speed of international transfers. For whatever reason, one connection, or to put it more generally, one transfer over tcp cannon hope to saturate the width of the pipe between the two parties. So to work around this 'segment' download managers were created to be able to run multiple concurrent transfers for the one file, which allowed for a much greater utilisation of the bandwidth between the two parties.

It doesn't sound like BT sync is currently implementing such a system for single large files, so I ask again whether it is on the roadmap?

Hope that makes sense.

Link to comment
Share on other sites

Bohdy,


 


Currently BTSync supports only one connection (if it connects over TCP), while the term connection is not applicable if we are talking about UDP.


 


The issue with speed is known and we are going to prepare a special debug build, which will allow us to find out the root cause of a low speed in some cases. I'll update this topic once we are ready with the build.


Link to comment
Share on other sites

  • 2 months later...

Couple of questions:

 

1) Were there any speed-related changes between 1.3.94 and 1.3.105? I ask because the external Synocommunity package for Synology DiskStation devices has not yet been updated to 105, so I am running 94 on my NAS.

 

2) Is there a changelog made public somewhere?

 

3) Using BT Sync with two devices, a server in North America and my NAS in Melbourne, Australia; speeds are slow*. I average about 300KB/s with BT Sync, but about 1.8–2.1MB/s using multiple connections over FTP (specifically, using lftp). Is this a limitation of the Bittorrent P2P 'swarm' technology, and I am seeing slow speeds because there are only two peers in the 'swarm'?

 

4) Following on from 3), if I'm speed limited by the number of peers, could we artificially populate one or both links with fake peers? Similar to traditional multiple connections using lftp or aria2, but with the BT P2P tech.

 

5) Is / will / should it be possible to saturate my bandwidth and maximise my connection speed using BT Sync given the distance between and low number of peers?

 

* Yes, speeds are this slow/just as slow on a single HTTP link because of the tyranny of distance. I get ~350KB/s over HTTP (single connection).

 

Thanks,

Alek

Link to comment
Share on other sites

1) No speed-related changes from 1.3.94 to 1.3.105

2) Yes, see here. Every topic starter contains changes and a link to previous release build changelog.

3) Most likely something (ISP were noticed to do that often) is throttling the connection. Usually more peers provide better speed.

4) Actually, even 2 peers should try to occupy all available bandwidth. There should be no need in additional fake peers.

5) Yes, it should be possible. In next release (1.4) we prepare a bunch of speed-related fixes as well as tool to debug and find bottlenecks.

Link to comment
Share on other sites

Thanks for getting back to me so quickly, Roman.

Hmm. Well I am moving house next week and disconnecting/reconnecting internet etc. Same ISP though. Once I've moved and reconnected, I will run some tests, do some research and try to find where the bottleneck could be on my side or at the level of my ISP. I will report back here with my findings in about a month.

It's good to hear that even just two peers should saturate a connection, though, because I'd much rather use BT Sync than other solutions such as FTP. I'm very impressed by BT Sync so far, so I hope I can solve these problems.

Link to comment
Share on other sites

  • 1 month later...

Dear users,

 

The upcoming 1.4 release now contains numerous speed optimizations as well as tool for debugging speed issues and detecting bottlenecks.

 

If you are ready to participate alpha testing and check if your speed issues are now resolved (or, otherwise - help us to debug them) - please PM me directly or just leave a message here.

Link to comment
Share on other sites

Dear users,

 

The upcoming 1.4 release now contains numerous speed optimizations as well as tool for debugging speed issues and detecting bottlenecks.

 

If you are ready to participate alpha testing and check if your speed issues are now resolved (or, otherwise - help us to debug them) - please PM me directly or just leave a message here.

 

 

Thanks for following up on this thread. While I am not interested in alpha testing, I look forward to the release of version 1.4. :)

Link to comment
Share on other sites

  • 2 weeks later...
  • 5 months later...

The saw shaped bottlenecks are easy to reproduce. Basically if I set the upload speed to let say 100kb and have download set to unlimited. Soon as current upload speeds reach 100kbs boom download and upload speeds all drop to 0. If both upload and download are unlimited, no issue. This only seems to be a issue with the upload being maxed out(for me at least). As a work around I've basically had to block peers I do not want to send to, as that it affects download speeds. Personally I feel upload limits should not affect download speeds. Also note I'm running 1.4.103

Link to comment
Share on other sites

Soon as current upload speeds reach 100kbs boom download and upload speeds all drop to 0. If both upload and download are unlimited, no issue. This only seems to be a issue with the upload being maxed out(for me at least).

I'm not uploading anything and no process is either:

AV1poVk.png

TfpWirb.png

@RomanZ it tops out at 3.63MB/s and 3.6MB/s is the average.

Here is a video of a 200MB test file:

(You will need to select 1080p/720p and go fullscreen as it's cropped)

The connection between my dedicated server and home is solid from start to finish over FTP. Using BTSync it's a never-ending wall of sawtooths.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.