Syncing Big Number Of Files


Recommended Posts

Hi,

We have a situation where we need to sync files between two servers. Files in server 2 are a two-months-old snapshot of files in server 1. So we just want to move new or changed files from server 1 to server 2 and we don't want to change files in server 1 as a result of this sync process.

What I've done to achieve this is added a folder in server 1 and copied the link and added it to server 2 in a read-only mode and pointed it to a folder that wasn't empty (contained the old snapshot).

The problem is there are 1.6 million files in the server 1 folder (and around the same thing in server 2) and it's taking ages to index.

My questions are:

1) Is there a better way of doing this using this software?
2) The source is being indexed at the moment and the destination also says 'indexing'. Is this refering to the source being indexed or the destination indexing is in progress in parallel to eliminate the need to move identical files? (90 percent of the files are there in both folders so no need to move).

Link to comment
Share on other sites

  • 1 month later...

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.