cod3monk3y

I haven't dealt with EBS, but I understand wanting a program that mirrors folders *across systems* to possibly mirror them across *drives* for something like backup. That's not really a far fetched concept. As a work-around what if you spun up some sort of VM that mapped the new drive and ran on a different IP, with the dedicated purpose of just running a second BT Sync instance? Then add that to the know hosts of the main server, or it may find it automatically with DHT/peer discovery. But in your scenario are you concerned about partial deployment? That is, some software trying to run on a partial built file system? Like an automated build that starts to run (like Jenkins) while only half of the code is synched? We have this scenario in our deployment. We're deploying media to 50 computers, and they can't run on partial sets of audio files, DLLs, animations, etc. So I've set up a sync folder and am using robocopy on windows to do a full copy when I know the system isn't in use (nightly). We also do log file backup from the 50 computers that needs to happen when the application is shut down. Others have mentioned this problem on this forum in regards to deploying web servers with BT Sync, and that it's a bad idea (because of the partial nature of the sync). Rather you'd want to shut down the server for a minute, deploy, then restart the server. (or of course, deploy to a second instance and remap your virtual server to the new deployment to reduce downtime). Using something like a script to copy (as suggested) would allow you to script synchronously, and I don't think you can get that functionality out of BT Sync. That is, of course, if this is at all applicable to your situation. Cheers, /cm

We ran our tests today, and BT Sync was not able to connect, up or down, through the firewall. "Relay" was enabled, and we even tried adding a "known host" to the synced folder on port 80 which I verified was working through another setup (PC1 -> Verizon Jetpack -> dynamic IP -> Linksys E4500 --> port forward 80:80XX --> PC2). It would be great to have more information on how the relay works so I can try to diagnose the problem, and work to properly get through the firewall. I'd be happy to work closely with the BT developers to provide diagnostics and a test case for an extremely tight firewall. Meanwhile, Dropbox worked (as expected since it's all over REST). Cubby also worked in both cloud hosting and peer-to-peer mode (which was a real surprise). I could not find documentation on Cubby's protocol, but it just works right out of the box and we're okay paying $9.99/month for a year for something that works. For my personal stuff (like my password safe) I'm really happy with Sync since it keeps everything out of the cloud, and I'm going to set it up to try out. I'll keep an eye on the relay situation and reconsider using it once that's resolved.

The networks at the schools are often extremely limited for obvious reasons. One school district blocks everything but HTTP, and is even blocking SSH tunneling over HTTP (using Apache's mod_proxy / HTTP connect method). FTP is shut down. STFP is shut down. Sites with the word "proxy" are blocked. I've read a few posts in this forum about IT blocking "bittorrent-like" traffic, and requiring ports to be opened. I'm pretty certain that UPnP is not going to work given the strength of the IT in the schools. I see the option for adding known hosts in the folder settings, which lets me specify a host and port which would let me connect to port 80, and I'm going to test this out next time I get to the schools. But most inbound traffic is blocked. We had this problem when we tried using FTP, since it assigns random ports for data transfer. SFTP worked on one site through a tunnel (again, the sites are not consistent and IT doesn't always have the time to accomodate our needs). I know that any return traffic trying to connect to the laptops on site will need to have the router forward an external port to the port I specify in the settings. But we won't be able to get IT to do that. I couldn't find information on the Bittorrent Sync relay anywhere. More information on this will help me know whether it will work and what to talk to with the IT departments in the districts. To get a common working solution for my problem for all the sites, I'll likely need sync option that communicates over HTTP exclusively, which means I'm probably stuck with WebDAV or Dropbox (which uses a RESTful web service API for transfers). I'd much prefer the Bittorrent Sync route because it reduces external bandwidth (our media files are pretty extensive) and is a great common solution for live mirroring back home on our servers with the collected data as well, and the files are not stored in the cloud (since they may contain sensitive student information). So to focus my question, how does the relay work? /cm p.s. If the name had given me a clue to answer my question, I would have answered the question myself. I do a great amount of research before posting questions on forums (here, stackoverflow, etc.), and only do so after an extended period of experimentation and effort. I've read a few of your posts on the wishlist, and many of them come across as condescending and arrogant, and this response is no exception. I appreciate any information you can supply in helping in my scenario, but please drop the assumptive belittling tone or don't reply at all.

I work for a small research company that makes educational software/games, and we've got a deployment of 50 computers in 10+ schools. We're currently synchronizing our application and media content from our server to the schools, and our log files from the schools to our server using SyncBack (FTP, yes I know -- without the S, no need to lecture). The schools have varying and inconsistent firewall rules, so the sync isn't happening at some locations. I know the limitations of the networks and why the transfers aren't working, so I'm not asking how to get through the firewall limitations This question is more to determine if btsync can get through strict firewall rules. Some locations allow FTP, SSH, SFTP, HTTP, and others are locked down to just HTTP. I've tried using WinSCP instead of SyncBack and tunneling SSH over HTTP using Aache mod_proxy, but even this is detected at some sites as a malicious proxy attack. At some sites we do not have the ability to open firewall ports. We need a synchronization solution that will work given these restrictions. Is btsync capable of handling this scenario? What ports does btsync use, what protocols for establishing the network (peer detection) and what protocol and ports for data transfer? Basically in the worst case all data needs to be transferred over HTTP protocol, and *not* using HTTP connect (e.g., Apache's mod_proxy ). In the best case the school is "wide open." I think btsync will work great for us, as it will limit the external bandwidth since not all 10 computers at each site will need to download the application updates. One can do the external download and the peers can sync from that "master" and from each other. In the worst case scenario that the school is completely shut off from the world, we could upgrade just by stopping by with an updated laptop and btsync would propagate all the changes to the peers on the LAN. I'd like to avoid that if possible. Thanks in advance! cm p.s. One of my alternative deployment solutions is using git to deploy the application (like Heroku uses). This should work since git has an HTTP protocol for pulling. The downsides are that we have a *lot* of data in our application/media and don't need/want to store the version history/deltas (in my tests the initial repo was about 1.8x as large as the folder hierarchy); and all the clients would have to pull all the changes, hogging network bandwidth.