snlehton

Delayed Indexing On Startup / Index Only When Low Disk Access Load

Recommended Posts

Hi,

 

I use BTSync regularly to sync photos, projects and backups across different locations. 

 

My biggest issue with BTSync is that when doing a cold boot to Windows, it takes ages to index all the folders added to sync. I have hundreds of gigabytes of raw photos to index, so it takes ages to do the indexing every time the PC is started. In addition to the indexing, I also have virus scanner running, and both are accessing HD, furthermore pegging the computer down. Currently I have BTSync not to start automatically when computer is started because the computer is literally unusable for the 10 first minutes after boot, but this is not the ideal solution for me.

 

I do use hibernation from time to time and this helps, but unfortunately that's not always possible.

 

My feature request is that I could somehow configure the BTSync either delay the indexing, or somehow do the initial indexing much more slower (not lower process priority but have delays between file reads to allow other HD intensive processes to able to progress on the background).

 

Even better solution would be to have an truly intelligent HD idle detection (not relying on CPU usage which has nothing to do with HD activity). Maybe BTSync could somehow measure the average HD read/write disk queue length Windows Resource Monitor is doing.

 

Are others having similar issue?

Share this post


Link to post
Share on other sites

Have you tried setting the advanced "disk_low_priority" setting to "true"? Whilst this won't prevent indexing (which Sync needs to do each time its run), it should help concede disk access to other applications.

Share this post


Link to post
Share on other sites

Hi Marko,

 

"true" is the default setting for "disk_low_priority". I've never set it to anything else as I really don't want BTSync to slow down the IO more. Should I try setting it to "false" instead?... 

 

I understand that the indexing is something needs to be done in order to sync, but for many sync folders I don't actually care if the sync happens immediately or at later point in time - as long as it happens eventually. It's more important to me to have a usable computer.

 

BTW SSD would help, but then again having hundreds of gigabytes of photos on SSD drive makes little sense... :)

Share this post


Link to post
Share on other sites

Sounds like someone needs a NAS ;)

I already have two servers to which I sync everything. How would NAS help here?  :huh:

 

I need to access the files where ever I am (on the go on gigs etc). Accessing files remotely (NAS over Internet) definitely wouldn't work. One raw photo can take up to 80 megabytes... modifying that over 3G connection is not going to work.

Share this post


Link to post
Share on other sites

Ah, ok. It sounded like you had everything only on your PC and synced that somewhere, so I thought a NAS that runs all the time and does the syncing could relieve your PC from that.

 

Off-topic and just wondering, because you probably know what you are doing: You really need to access ALL your RAW photos ALL the time?

 

 

Maybe there could be an option to skip the startup indexing and just re-use the last known index? It should come with a big honking "I KNOW I CAN SHOOT MYSELF IN THE FOOT WITH THIS" warning dialog, but for users that can guarantee to have BTSync running all the time and not to change any files while it is not, re-indexing on every start is just a waste of time and resources.

Share this post


Link to post
Share on other sites

Thanks for reply.

 

The problem is that I don't know before-hand what photos I'm going to need (usually for reference). I could offload some of the photos into archived catalog (using Lightroom here) and I do, eventually (photos older than few years). But the set I need to have is still quite large. And I do have the disk space, so that's not the problem either.

 

It would be just fine if I could say that delay indexing for 10 mins or so. As if BTSync was started later on for certain folders. 

 

I don't know how BTSync works internally, but your suggestion makes sense. I think many (if not all) file systems support modification journals / hierarchical time-stamps, so BTSync could somewhat easily catch up indexing if there were changes since last time. This would be the ideal solution.

Share this post


Link to post
Share on other sites

+1 for a delayed start or some way to index faster. Btsync is quite the hard drive thrasher when you first turn on the computer. Anymore if I want to use the computer I have to turn it on then do something else before I actually come back to start using it

Sent from my SCH-S738C using Tapatalk

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.