Incremental Backup on Amazon EC2 / S3

Somebody suggested using Amazon EC2 to provide an incremental backup interface to S3. For the likes of rsync to be truly effective, you need to have an rsync program running near the data store. It struck me, you could use an EC2 instance with free, high-speed bandwidth to S3 to do exactly that.

Using S3fuse (currently down) I’m sure you could script something so users log in to the EC2 instance and then mount their S3 bucket locally. Then rsync would work pretty effectively I reckon.

Could even be an interesting business model.

5 thoughts on “Incremental Backup on Amazon EC2 / S3

  1. Why pay monthly fees to backup your data online?

    With Zoogmo you get absolutely FREE and UNLIMITED offsite backup!

    Zoogmo makes backup cool by using existing internet connections, available space on computers & your great relationships with your friends to automatically and securely back up your files to a place you trust. YOU control where your files are backed up by building your personal network of your own or your trusted friends’ computers or USB drives.

    Shouldn’t you decide where your precious data will be backed up?

    Because Zoogmo can make redundant backups of your files to multiple locations, you get a more secure backup and also a faster BitTorrent-like restore. Zoogmo partners decide how much space to allocate to each other on their computers and then Zoogmo runs in the background, automatically backing up changes on your computer incrementally. All backups are encrypted before they leave your computer so only you know what you are backing up and absolutely no one can read your files.

    If you backup between your own computers at home, backup and restore happen at LAN speed which is 30-50 times faster than the internet.

    Zoogmo turns spare disc space into a backup community – backup meets social networking. There’s even a cool Facebook application that you can use to tell your network of friends that you are looking for backup space.

    Download now at http://www.zoogmo.com to begin turning your social network into your backup network.

  2. The current version is for Windows XP and Vista. Future plans call for Linux and Mac versions.

    After the initial backup, only changed files are backed up so yes it does support incremental backup.

    Thanks for the great questions!

    Dov Sugarman
    CEO
    Zoogmo – Your Online Backup Community

  3. Seems like you would have to have a LOT of friends to make this work. That’s the problem with bit torrent. It’s a great technology but requires hundreds to thousands of machines.

    Granted, a half dozen or so machine would be pretty cool but I just wouldn’t like the odds. People format all the time. People turn their computers off all the time. Etc. Like I said, neat idea but it would take hundreds or thousand to make it really rock.

    Curly rocks! lol
    http://cbmeeks.blogspot.com

  4. > For the likes of rsync to be truly effective
    Rsync to s3 mount file system is not efficient!
    Given that S3 is all or nothing, i.e. if you want to change a file you have to PUT the whole thing again.
    Every time a local file has been changed it will uploads the hole new file, not just what has changed. That means that if you are using rsync for doing regular backups you are wasting unnecessary bandwidth.

    You can bypass this limitation using out rsync to s3 gateway.
    For more information take a look at out new service http://www.s3rsync.com/

    Regards,
    Addady

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>