AutoHotkey Homepage AutoHotkey Community
Let's help each other out
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Sync BIG files over the internet?

 
Reply to topic    AutoHotkey Community Forum Index -> Utilities & Resources
View previous topic :: View next topic  
Author Message
TheLeO



Joined: 11 Jun 2005
Posts: 264
Location: England ish

PostPosted: Thu Jan 28, 2010 10:10 am    Post subject: Sync BIG files over the internet? Reply with quote

Hey guys,

I do a lot of work at home, and I need to keep my home and work environment synced up, unfortunately a laptop won't get the job done, I got 2+ Tb of stuff. :-/


I use www.mesh.com to sync notebooks/programs/files/documents/pictures/scripts/exc

But I'm not sure how I should sync big stuff
e.g like my Virtual lab
( contains 550 gb's worth of VM's, xp/vista/win7/2003/2008/2000 with Lots of snap shots and in multiple Languages).

I've got a home server with a static ip/dns and a 24/24 conneciton.

I've had a go at DC++, set up my own hub, and copied the lab across the internet, but the difficulty here is to keep the two copies synced up.

I tried ftp Sync, but that doesn't work well for files over 4gb.

I tried iScsi over internet, but that doesn't seem to work smoothly either. sometimes works sometimes not. (good for listening to music thouhg).

Has anyone done that before? Any reccomendtaions?

(I'm not so good with Linux, but I know my way round windows quite well).
_________________
::
I Have Spoken
::
Back to top
View user's profile Send private message Visit poster's website MSN Messenger
SoLong&Thx4AllTheFish



Joined: 27 May 2007
Posts: 4999

PostPosted: Thu Jan 28, 2010 11:06 am    Post subject: Reply with quote

It is not easy to use and setup BUT if you do manage to use rsync it is a hoot, it will sync large files by only up/downloading the changed sections of a file, so rather than FTP 500 mb just because you added two seconds of data to a file at the end it will use an algorithm to calculate the changes

http://en.wikipedia.org/wiki/Rsync
Quote:
The rsync utility uses an algorithm (invented by the Australian computer programmer Andrew Tridgell) for efficiently transmitting a structure (such as a file) across a communications link when the receiving computer already has a different version of the same structure.


A good starting point:

http://lifehacker.com/software/rsync/geek-to-live--mirror-files-across-systems-with-rsync-196122.php

Edit: a bit more user friendly and also using the same algorirthm is http://www.cis.upenn.edu/~bcpierce/unison/
_________________
AHK Wiki FAQ
TF : Text files & strings lib, TF Forum
Back to top
View user's profile Send private message
TheLeO



Joined: 11 Jun 2005
Posts: 264
Location: England ish

PostPosted: Mon Jul 19, 2010 8:26 pm    Post subject: Reply with quote

done it over gBridge btw, works very well.
_________________
::
I Have Spoken
::
Back to top
View user's profile Send private message Visit poster's website MSN Messenger
Display posts from previous:   
Reply to topic    AutoHotkey Community Forum Index -> Utilities & Resources All times are GMT
Page 1 of 1

 
Jump to:  
You can post new topics in this forum
You can reply to topics in this forum


Powered by phpBB © 2001, 2005 phpBB Group