[SOLVED] Folders never finish syncing

[Bootalito]

Most likely cause: Using a cheap Synology NAS(816+) that does not have the resources to properly index all of the files required by Resilio. The Synology NAS was also not properly syncing Google Drive via its "Cloud Sync" app either.  This was the clue that allowed me to figure it out.  I don't know conclusively

The solution: Commissioned a Windows 10 computer to replace the Synology NAS for samba share, google drive syncing and resilio, along with Plex and other things I was using the NAS for.

------------------------------------------------------------------------------------

Original Post:

The Setup:

I have three licenses, one Server and two regular licenses two regular, I'll call LocalSync and RemoteSync.  Server is WinServer2016, LocalSync is Windows10Pro, and RemoteSync is a Synology NAS.  WinServer2016 is the "owner" (or more actually the source of all data) of 4 folders configured as encrypted folders.  LocalSync syncs those 4 folders in Read only modeand is located one gigabit switch away from WinServer2016.  Additionall LocalSync is also the source of 2 encrypted folders.  So LocalSync has 4 Read Only syncs, and 2 read/write syncs.  RemoteSync is located 30 miles away from my business in my home.  I have two pfsense routers on either side with a permenant OpenVPN connection.  RemoteSync has all six folders configured as encrypted.  All three machines think they are on a local LAN (and two are..) and thus go full speed, limited by my businesses upload speed of 20mbps.  In all three locations in all folders, I DO NOT have "Store Deleted files in folder archive", i.e. delete ANYTHING that should not be there so I can compare folder size and number of files more easily (except the couple of extra files in ".sync"..np).  I also have "Overwrite any changed files", again so I can more easily compare folder size and number of files.

The four folders between WinServer2016 and LocalSync are always 100% synced, no problem.  
Three of the Four folders from WinServer2016 sync fine to RemoteSync.
One out of Two folders from LocalSync have finished syncing to RemoteSync
The last folder from LocalSync I've had paused to allow the other ones to finish syncing because they are very large volume backups (hundreds of gigabytes in a couple of files), so this one is not relevant...yet...unless it doesn't finish in a few days, then I'll be back

So my problem is the two folders, one from WinServer2016 and one from LocalSync that just seem to be stuck.

On RemoteSync I took some screenshots to remember where the sync was on each day:
On 1/21 the folder from WinServer2016 was 98% complete, and the folder from LocalSync was 60%
On 1/22 the folder from WinServer2016 was still 98% complete, and the LocalSync folder was 83%
On 1/23 (today) the WinServer2016 was 98% and Local sync was still 83% (Note that on LocalSync, it thinks its only 42% complete.

LocalSync folder should have 58,121 files.  On RemoteSync it only has 57,950.

A picture is worth 1000 words so I made a diagram

What type of troubleshooting steps can I take to figure out what the problem is?  One thing I'm thinking of doing is configuring a windows 10 Server at home for syncing, instead of my Synology NAS, as I think the problem may be my NAS.  Although its not out of resources or anything and isn't throwing any errors.

[Andy+]

Unfortunately, I also have such folders. I have 3 Synology servers (DS1815 +, 415+, 412+), 3 Windows computers, 2 smartphones, on which Resilio is installed.

It happens again and again that not all data is synchronized, especially between the Synology servers. I was able to fix this time and again by optimizing the permissions for groups and owners on the servers in the affected directories. But for some time now I have 3 directories that are complet for 99%, 98%, 99% and so apparently are not completely synced. Any files in the peer list that are pending syncing will not be synced because they already exist.

As a rule, another measure is that I separate and reconnect the peers. In this case this did not help either. However, I did not delete the .sync directory, which contains sync data. Does that even benefit?

[Bootalito]

So I'm trying to sync the files via a Docker on UNRAID.  But now I'm running into a file name length issue

Resilio is creating encrypted files with 255+ characters in their file name.  I see that there is a really old post about this that I'm about to resurrect.

[Bootalito]

I've determined that the issue was probably the Synology NAS.  I have a relatively cheap Synology NAS and I don't think it was good enough to index the files appropriately.  I determined this by simultaneously discovering that the Cloud Sync App I was using to sync to my google drive was also not properly syncing.  It SAID it was done, but I would make changes to files several folders deep and it never updated it.

My solution was to install resilio on windows 10 and it is syncing as expected.

[Andy+]

The approach that Resilio might not work properly for performance reasons is not factually wrong. But in this case, I don't think it's right. My Synology DS412 + is weaker than the other two, which are stronger. Still, the phenomenon is that the two stronger servers is affected.

But there is another aspect. The three incomplete folders are related. I have a main folder 1 (shared folder), in which there is a subfolder 2 and below that a subfolder 3. For various reasons, I have to synchronize folders 1, 2, 3 in separate peers. It is clear that when changes are made in folder 3, peer 2 and peer 1 want to start a synchronization, seperate each. The changes in folder 3 are registered in each of peers 1, 2, 3. I think that such effects can therefore occur.

A possible test would be to separate all the peers except the three incomplete ones to see what happens next. Because three peers are few. At the moment there are 52 productive peers.