ms2oo8 Posted October 22, 2014 Report Share Posted October 22, 2014 What is the bahviour of Bittorrent Sync client? I just finished an initial sync of 2.1TB of files sitting on a NAS, with the Bittorrent Sync client installed on a Windows 7 desktop running Sync 1.4.93. The inital indexing took about 12 hours, and now that I've restarted the client the status says Indexing again. Can I expect a 12 hour Indexing period any time I restart a client with this amount of files? My impression was that Indexing would happen one time, and be smart enough to know the files have been Indexed even after Bittorrent Sync restarts?Also if this really is the case, is there a way to tell how much progress the Indexing has made? Initially, the file of the files grew, and I could tell how far along it was. Now that the files are indexed, the size alraedy shows 2TB and it's indexing. Quote Link to comment Share on other sites More sharing options...
GreatMarko Posted October 22, 2014 Report Share Posted October 22, 2014 My impression was that Indexing would happen one time, and be smart enough to know the files have been Indexed even after Bittorrent Sync restarts?Sync needs to update its index each time it starts - otherwise it has no way of knowing if the contents of the folder's its monitoring have changed in any way whilst it's not been running! This "index update" process shouldn't take anywhere near as long as the "initial index" process when you first added the folder to Sync is there a way to tell how much progress the Indexing has made?Not at present, Sync will just indicate "Indexing...". I suppose ideally the Status or Progress column should indicate how far through the indexing process Sync is... so perhaps this is a suggestion for the Feature Requests forum. Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted October 23, 2014 Author Report Share Posted October 23, 2014 (edited) ok thanks for the quick response. It's still Indexing but it seems like it's reset again, and is around 500 GB and counting up again Edited October 23, 2014 by ms2oo8 Quote Link to comment Share on other sites More sharing options...
RomanZ Posted October 23, 2014 Report Share Posted October 23, 2014 @ms2oo8Can I please take a peek at your debugging sync.log? As @GreatMarko said, it should not index that long second time (unless lots of files has changed). Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted October 25, 2014 Author Report Share Posted October 25, 2014 Sure if I can figure out how to send it Because the initial sync finally finished, now I've added 5 MB of files to the one NAS, and it's sitting quite awhile in Indexing mode again, just for that 5MB of new files added. Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted October 28, 2014 Author Report Share Posted October 28, 2014 I'm still having issues with this. Both clients have gone into endless Indexing status (for days) Quote Link to comment Share on other sites More sharing options...
RomanZ Posted October 29, 2014 Report Share Posted October 29, 2014 @ms2oo8Our support still did not manage to get logs from you. Once you provide us logs - we'll start analysis ASAP and hopefully will find out what makes your Sync indexing all the time. Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted October 30, 2014 Author Report Share Posted October 30, 2014 I sent the logs via a Dropbox link this time. Could you confirm you received it? Quote Link to comment Share on other sites More sharing options...
Helen Posted October 30, 2014 Report Share Posted October 30, 2014 @ms2oo8, got them. Thank you. Quote Link to comment Share on other sites More sharing options...
Catsrules Posted October 30, 2014 Report Share Posted October 30, 2014 How many files are you trying to sync? I heard on a podcast,that someone tried to sync there giant family photo library that contained tens of thousands of files. That it just killed their home server because it had to rescan every single files over and over again. But this was when BTsync first came out. So I bet there has been improvement. Quote Link to comment Share on other sites More sharing options...
nop Posted October 31, 2014 Report Share Posted October 31, 2014 How many files are you trying to sync? I heard on a podcast,that someone tried to sync there giant family photo library that contained tens of thousands of files. That it just killed their home server because it had to rescan every single files over and over again. But this was when BTsync first came out. So I bet there has been improvement. Even Boeing 747 can't kill a good server In all modern operating systems all frequent read\write operations on HDD are cached in computer RAM. And each HDD has internal cache too! So don't worry about "rescan operations". Windows Explorer doing this always for a lot of system files right after powering on the pc. http://en.wikipedia.org/wiki/Disk_bufferhttp://msdn.microsoft.com/en-us/library/bb742613.aspxhttp://www.wikihow.com/Change-Process-Priorities-in-Windows-Task-Manager Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted October 31, 2014 Author Report Share Posted October 31, 2014 it's 2TB of data. (628,000 files in 30,311 folders)I have the Sync app installed on a Windows boxes on either end, (i5 750 x64 Win 7 with 8GB RAM and a i7 2600 x64 Win 7 with 8GB RAM) and both are not performing any other tasks. I reconfigured the Peers to map via a drive letter vs the UNC path. Everything synced up, except 1 open office file, which was locked due to it being open. When I closed it, sync stayed stuck at the locked file status. So I closed the app on both ends again, and now we're back to Indexing . . . .having said all that, it shows Indexing status as we speak, but it seems to be syncing any changes I make immediately right now Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted November 2, 2014 Author Report Share Posted November 2, 2014 I'm ready to look for another solution like AeroFS. This really doesn't seem to be working. Quote Link to comment Share on other sites More sharing options...
RomanZ Posted November 4, 2014 Report Share Posted November 4, 2014 @ms2oo8What happened? From your previous post it looked like Sync was doing its job. Quote Link to comment Share on other sites More sharing options...
jdyer Posted November 5, 2014 Report Share Posted November 5, 2014 So I think I am seeing something similar which I am trying to get help w/ in ticket #32426-btsync-appears-to-be-indexing-ignored-files. My problem is I have a large number of files generated each hour ( logging ) which seems to have to be indexed and takes hours. the ignoreSync pattern seems to be working by not syncing these files but unfortunately is seems to be indexing them regardless of that config... Its quite disappointing Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted November 5, 2014 Author Report Share Posted November 5, 2014 @ms2oo8What happened? From your previous post it looked like Sync was doing its job.I think it is, but it seems to Index almost permanently. I'm concerned that it takes so long to Index changes because I'm afraid that it won't keep up. Quote Link to comment Share on other sites More sharing options...
RomanZ Posted November 6, 2014 Report Share Posted November 6, 2014 @jdyerIt looks to be different case. In your case Sync is simply indexing files in folder that is added to ignore list (which is quite normal as folder is already in the tree), while in @ms2oo8 case indexing never completes. @ms2oo8If you are willing to help us in debugging this issue - well need a debug logs from your computers. Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted November 12, 2014 Author Report Share Posted November 12, 2014 So I did some testing with RomanZ and it seems like my install is stuck completely re-Indexing almost constantly. We haven't figured out why yet, but think it might be due to the folder locations being mapped drives on SMB network shares. It keeps re-indexing previously indexed files, that I am 100% certain haven't been changed by a person. This leaves a few scenarios possible1) software on the NAS box is reading files (for whatever reason, rsync backup of the NAS box to another NAS box etc) and is triggering Sync to re-index somehow2) a bug in the Sync software as expained above I'd be inclined to think it's a bug, since I have another NAS with a mapped SMB share on the other end, with the same issues, but it's a different brand of NAS box, with no backup configured on it. Quote Link to comment Share on other sites More sharing options...
RomanZ Posted November 12, 2014 Report Share Posted November 12, 2014 I confirm. Sync is not working smoothly with SMB shares. We are checking in the lab for possible reason and solution. Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted November 25, 2014 Author Report Share Posted November 25, 2014 Any updates on this issue yet? Quote Link to comment Share on other sites More sharing options...
RomanZ Posted November 26, 2014 Report Share Posted November 26, 2014 Not yet! Though we are working on it, will update when get some news. Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted December 9, 2014 Author Report Share Posted December 9, 2014 Is this fixed in the 2.0 Beta? Quote Link to comment Share on other sites More sharing options...
RomanZ Posted December 9, 2014 Report Share Posted December 9, 2014 @ms2oo8I don't have exact answer for you as we haven't found the root cause in 1.4 yet. There are numerous core changes in 2.0, so it might happen that issue was already resolved - and we'll find that our only when we find your issue root cause. Quote Link to comment Share on other sites More sharing options...
ms2oo8 Posted December 9, 2014 Author Report Share Posted December 9, 2014 Is this bug being tracked in your system? Also when is 2.0 ready for testing? Quote Link to comment Share on other sites More sharing options...
GreatMarko Posted December 9, 2014 Report Share Posted December 9, 2014 Is this bug being tracked in your system? Also when is 2.0 ready for testing? As RomanZ has indicated, they are aware of the issue: "we are working on it, will update when get some news" and "I don't have exact answer for you as we haven't found the root cause in 1.4 yet" Also when is 2.0 ready for testing?It'll be ready when it's ready - if you've followed the "Sign Up" button in this blog post, you'll be on the list and be amongst the first to know once 2.0 becomes available for testing. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.