Lee133

"wrong Number Of Pieces For File" Or Endless "processing File"

Recommended Posts

First of all, I have enabled debug logging but the debug.txt file only contains "FFFF".

 

The problem:

 

System A has about 100 GB of photos which need to synced with system B.  Certain files appear in the "Transfer" tab of BTS yet there is no activity listed under the "UP" or "Down" headings.  After several seconds, the file disappears from the list yet no file can be found on system B.

 

Looking deeper, I searched through the sync.txt file and found a peculiar set of entries related to the unsuccessfully synced files (appended below).  It seems that any problematic file transfer that shows the symptoms mentioned above first reports:

 

"missing metadata for file...will force re-indexing",

 

then

 

"wrong number of pieces for file...without metadata, resetting it".

 

Moreover, the file continues to undergo "processing file" numerous times without conclusion.

 

1. What is going on and where do you suspect the problem?

 

2. What can I do to remedy the situation?

 

Thank you!

 

 

Below, specific entries from the sync.txt file pertaining to files that failed to transfer:

 

[2013-12-28 00:37:24.547] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\12\Resaves\DSCF1405.jpg 1388211256 2584450
[2013-12-28 00:37:24.548] SyncFilesController: missing metadata for file 2005\12\Resaves\DSCF1405.jpg, will force re-indexing
[2013-12-28 00:37:24.633] New torrent created for file 2005\12\Resaves\DSCF1405.jpg mt:1388211256 57A94DFEEB2230B957A34FCCDA3499A1674E2A1E
[2013-12-28 00:37:24.643] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\12\Resaves\DSCF1404.jpg 1388211254 2858285
[2013-12-28 00:37:24.646] SyncFilesController: missing metadata for file 2005\12\Resaves\DSCF1404.jpg, will force re-indexing
[2013-12-28 00:37:24.710] New torrent created for file 2005\12\Resaves\DSCF1404.jpg mt:1388211254 9B7F3530B692E5C2093E2745B02313F4219F862F
[2013-12-28 00:37:24.748] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\12\Resaves\DSCF1403.jpg 1388211252 2586182
[2013-12-28 00:37:24.749] SyncFilesController: missing metadata for file 2005\12\Resaves\DSCF1403.jpg, will force re-indexing

...

[2013-12-28 00:37:35.394] Merge: processing get_nodes message for /2005/12/Resaves/DSCF1403.jpg
[2013-12-28 00:37:35.394] Merge: processing get_nodes message for /2005/12/Resaves/DSCF1404.jpg
[2013-12-28 00:37:35.395] Merge: processing get_nodes message for /2005/12/Resaves/DSCF1405.jpg

...

[2013-12-28 00:37:35.519] Merge: will send files for /2005/12/Resaves/DSCF1403.jpg
[2013-12-28 00:37:35.519] Merge: will send files for /2005/12/Resaves/DSCF1404.jpg
[2013-12-28 00:37:35.520] Merge: will send files for /2005/12/Resaves/DSCF1405.jpg

...

[2013-12-28 00:39:00.865] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1405.jpg 1388209332 1868072
[2013-12-28 00:39:00.866] SyncFilesController: missing metadata for file 2005\07\Resaves\DSCF1405.jpg, will force re-indexing
[2013-12-28 00:39:00.936] New torrent created for file 2005\07\Resaves\DSCF1405.jpg mt:1388209332 E38C52612B84C1CF565550A4F8232A2FB988A0C6
[2013-12-28 00:39:00.944] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1404.jpg 1388209330 2093163
[2013-12-28 00:39:00.945] SyncFilesController: missing metadata for file 2005\07\Resaves\DSCF1404.jpg, will force re-indexing
[2013-12-28 00:39:01.004] New torrent created for file 2005\07\Resaves\DSCF1404.jpg mt:1388209330 C6C6AF6F7EB492739E1AC0C249FA7F8973075F66
[2013-12-28 00:39:01.013] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1403.jpg 1388209328 2008988
[2013-12-28 00:39:01.013] SyncFilesController: missing metadata for file 2005\07\Resaves\DSCF1403.jpg, will force re-indexing

[2013-12-28 00:39:01.134] New torrent created for file 2005\07\Resaves\DSCF1403.jpg mt:1388209328 48B302F224DD2F4EF60A57F074A79D1FE8F24F1B

...

[2013-12-28 00:39:08.603] Merge: processing get_nodes message for /2005/07/Resaves/DSCF1403.jpg
[2013-12-28 00:39:08.603] Merge: processing get_nodes message for /2005/07/Resaves/DSCF1404.jpg
[2013-12-28 00:39:08.603] Merge: processing get_nodes message for /2005/07/Resaves/DSCF1405.jpg

...

[2013-12-28 00:39:08.688] Merge: will send files for /2005/07/Resaves/DSCF1403.jpg
[2013-12-28 00:39:08.688] Merge: will send files for /2005/07/Resaves/DSCF1404.jpg
[2013-12-28 00:39:08.688] Merge: will send files for /2005/07/Resaves/DSCF1405.jpg

...

[2013-12-28 00:44:04.676] SyncFilesController: wrong number of pieces for file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1403.jpg without metadata, resetting it
[2013-12-28 00:44:04.677] SyncFilesController: wrong number of pieces for file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1404.jpg without metadata, resetting it
[2013-12-28 00:44:04.685] SyncFilesController: wrong number of pieces for file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1405.jpg without metadata, resetting it

...

[2013-12-28 01:06:43.790] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1405.jpg 1388209332 1868072
[2013-12-28 01:06:43.790] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1404.jpg 1388209330 2093163
[2013-12-28 01:06:43.791] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\07\Resaves\DSCF1403.jpg 1388209328 2008988

Share this post


Link to post
Share on other sites

1. Is the location you are syncing to full?

2. Is the files damaged in any way?

3. And did the files change after you started syncing?

 

1. The destination location seems to have plenty of space to accommodate the transfer. (e.g. about 280 GB of free space)

 

2. I could find no evidence of damage to the jpgs.  All applicaitons seem to be able to read and process them.  I have even taken the extra step, using Lightroom, to save duplicate files in a sub-directory, but even the duplicates fail to sync.

 

3. After starting the sync, I do not make any changes to the files.  I cannot say with absolute certainty that there is not a process running in the background that might be making changes to these files (for whatever crazy and unlikely reason there might be).

 

Any ideas, anyone?

 

Thanks for your help!

Share this post


Link to post
Share on other sites

[2013-12-28 00:37:24.547] SyncFilesController [file updated]: processing file \\?\C:\Users\Jo Beth\Pictures\2005\12\Resaves\DSCF1405.jpg 1388211256 2584450
[2013-12-28 00:37:24.548] SyncFilesController: missing metadata for file 2005\12\Resaves\DSCF1405.jpg, will force re-indexing

 

2584450 is a unix time stamp, this is almost epoch (when God invented time, around 1/1/1970). 1388211256 also a time stamp for Sat, 28 Dec 2013 06:14:16 GMT, I am assuming either your time converted to GMT (or your time is displayed in CET).

If you check the file time stamps, can you read them? I assume BTSync will check when the file was edited, clearly it fails to do this for some reason. Are they valid times? Could you open them in lightroom, edit something (add a few lines of pixels or something) then save them again. Check the time it is last edited, if it is a sane date (ie after 1/1/1970), and see if they now will sync.

I am sure there are other ways to edit time stamps in Windows, but I don't know how, and don't care enough to figure it out.

Share this post


Link to post
Share on other sites

Any ideas, anyone?

 

I'm thinking about folder Resaves. Is it means that you added all your photos to batch processor in editor like Photoshop or any other image converter?

Can you check what processes running in background and watching your Pictures library which have you added into btsync?

 

Maybe some kind of application like Sony Picture Browser doing scanning of photo library for changes (reading file attributes for example)  every 5 min. and thereby locking an access to file for other applications.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.