joshuahab

1TB of data stops indexing after 62GB

Recommended Posts

I have just downloaded the latest version of Bittorrent Sync on Ubuntu via the apt archive. I added a folder and used as my secret a read-only secret from a friend's computer running on OS X. But he's not actually connected right now.

The software started scanning my drive, which contains 1TB of data (my friend initially copied the files to this drive locally so we wouldn't have to push all 1TB over the Internet). I monitored the progress of indexing by watching the web UI and could see it making progress (the total size was growing). But it stopped making progress at 62.1GB in 452 files, whereas the directory actually has 971GB in 18284 files.

Any idea what's going on? The logs don't have any useful data in them and the daemon itself appears to be idle.

Thanks,

Josh

Share this post


Link to post
Share on other sites

Hello!

About the same problem - I opened a ticket and have some contacts with BitTorrent team. Problem seems to be at sqlite level, some trailing locks or something like that.

You can see this by enabling the debug mode, start it over - you'll stumble on SyncDB errors stating it's unable to complete the statement (i.e. cannot insert new content) - the DB is locked.

Hopefully this will be corrected shortly.

Cheers,

C

Share this post


Link to post
Share on other sites

Database issues (if any) should not stop indexing. However indexing will be aborted if some error happens while enumerating files (e.g. if some folders are not accessible for Sync). If you enable debug log, you should see at what path it stops.

Share this post


Link to post
Share on other sites

Hmm, it seems to have mysteriously unstuck itself.

A couple questions though:

1. I tried to enable debug logging but I couldn't follow the instructions at [0]. I couldn't find my .sync directory. The Ubuntu package has no binary called "btsync" (only btsync-daemon). The btsync-daemon binary is in /usr/lib/btsync, which has no .sync directory in it. I also couldn't find a .sync directory in /var/lib/btsync, which is where the log file and all data files are. How can I enable debug logging?

2. How can I know that btsync is actually working if it can fail without signaling any kind of error? When indexing was stuck for me the UI indicated no error, and there were no errors in the (non-debug) logs in /var/lib/btsync/sync.log. I want to have confidence from here on out that the files are actually being synced correctly.

Thanks,

Josh

[0]

Share this post


Link to post
Share on other sites

I experience the same issues with big folders. They seems to never get indexed completely. e.g. 11.300 of 11.800 files etc. This is a pitty as it makes the software not applicable for me. Are there any solutions or announcements concerning this issue yet?

Share this post


Link to post
Share on other sites

I have a folder >5TB with >1m files and indexing stops at 1000.8GB on 227715 files

 

I was very excited with this when I did small tests but in order for it to work for me it must support large folders.

 

Eric

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.