azim58 Posted September 1, 2015 Report Share Posted September 1, 2015 Is there some way that I can limit the amount of memory (RAM) used by bittorrent sync (btsync) in Linux (Ubuntu). I am syncing about 500 GB of files from one machine to the Linux machine. However, about 90% of the RAM is being used by btsync during this process (which will take many days). I usually only remote to this Ubuntu computer instead of directly controlling it, and when 90% of the RAM is being used, the computer becomes very unresponsive. Is there some way that I can limit the amount of RAM used by btsync? I would be willing to slow down the sync process if I can limit the RAM. Quote Link to comment Share on other sites More sharing options...
GreatMarko Posted September 1, 2015 Report Share Posted September 1, 2015 Check out the advanced preferences available in Sync. For example, reducing "recv_buf_size" and "send_buf_size" will reduce the memory footprint of Sync Quote Link to comment Share on other sites More sharing options...
azim58 Posted September 1, 2015 Author Report Share Posted September 1, 2015 Hmmm. . . this didn't seem to work. I tried setting both of those values to 1 and then restarted btsync, but the RAM still climbs up to 90%. Note that in Linux I can't just go to advanced settings and click more options. I had to create a btsync.conf file, as described here: http://nickology.com/2013/05/06/bitorrent/ After getting the text for the conf file by typing "./btsync --dump-sample-config" I then added the lines to set the recv_buf_size and send_buf_size like this: ,"recv_buf_size" : 1,"send_buf_size" : 1 However, the default is 10 Mb and the lowest I can set the value is 1 Mb. I then started btsync while passing the config file as a paramter. At 1 Mb the RAM still climbs to 90%. Quote Link to comment Share on other sites More sharing options...
Helen Posted September 2, 2015 Report Share Posted September 2, 2015 azim58, An how many files are in the folders? Are the folders physically located on the machines? Can you please send logs to the support? in Linux I can't just go to advanced settings and click more options. I had to create a btsync.conf file, For web ui use this script to change the parameters right in settings. the syntax will be python btsync_edit_settings_w4.py /path/to/.sync/settings.dat set <parameter_name> %value"and check with get Quote Link to comment Share on other sites More sharing options...
azim58 Posted September 6, 2015 Author Report Share Posted September 6, 2015 Bittorrent sync is using up all of my ram (90%) on a linux machine when trying to sync 500 gb from a Windows computer to an external drive on a Linux computer.There are 1,690,755 files and 140,126 folders which total 411 GB. I tried to send the log files to bittorrent sync, but the log files were too big. They were about 100 MB, but the website would only accept log files that were about 20 MB. Quote Link to comment Share on other sites More sharing options...
Helen Posted September 7, 2015 Report Share Posted September 7, 2015 azim58, We've sent you the link to upload logs to your current mail. Quote Link to comment Share on other sites More sharing options...
azim58 Posted September 7, 2015 Author Report Share Posted September 7, 2015 Okay thanks! Quote Link to comment Share on other sites More sharing options...
Helen Posted September 7, 2015 Report Share Posted September 7, 2015 azim58, got them, but do you have logging enabled? that looks like non debug logs. And one more thing - memory dump: while sync is running and rating memory in terminal run gcore -o /path/to/core.filename <pid_of_sync>upload that core file as well. thank you. Quote Link to comment Share on other sites More sharing options...
AlexanderD Posted September 8, 2015 Report Share Posted September 8, 2015 Please, set maximum size for core dump before collecting it. Run in terminal:ulimit -c unlimited Quote Link to comment Share on other sites More sharing options...
iranzo Posted March 7, 2017 Report Share Posted March 7, 2017 Was this finally an isolated issue or something more general is going to be provided? Quote Link to comment Share on other sites More sharing options...
RRM Posted April 19, 2017 Report Share Posted April 19, 2017 Would love to know how this issue can be resolved in the current version. Any news? Quote Link to comment Share on other sites More sharing options...
BaneOfSerenity Posted August 9, 2017 Report Share Posted August 9, 2017 I'm not sure these power user options are working as intended or they are not documented correctly. Both recv and send are 128 by default, which in theory should be 256mb plus some amount of application overhead, yet i'm seeing well over 700mb being used just for resilio sync while not preforming any sync operations. Quote Link to comment Share on other sites More sharing options...
WeeGee Posted August 12, 2017 Report Share Posted August 12, 2017 AFAIR, btsync uses a few kB of RAM for every single file it has to manage, additionally to the recive and send buffers and other data. That adds up for millions of files... same problem here on my NAS. Quote Link to comment Share on other sites More sharing options...
Timbo Posted August 19, 2017 Report Share Posted August 19, 2017 I had Sync on a VPS with 512MB of RAM and syncing about a half a dozen files of about 2GB average in size. Sync crashed often. When the VPS was increased to 1GB of RAM, the crashes stopped. When I was investigating crashes, rlsync was using more than 350MB of RAM. I was not expecting this, considering a good chunk of NAS' only have 512MB of RAM. Developers need to design specifically for embedded devices, they don't have the resources PC's have. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.