Comments on: How I automated my backups to Amazon S3 using s3sync.

By: Amedee

Amedee — Mon, 16 Aug 2010 14:47:02 +0000

@Slow Down Music:
I prefer BOTH: a hands-on backup AND a backup at a remote location. Preferably in another continent.
Just in case a meteor strikes…

By: Kelso

Kelso — Thu, 12 Aug 2010 09:04:30 +0000

Will this method still work?

By: Grid Computing, Backups and Hurricanes « Features « Web Host Blog

Grid Computing, Backups and Hurricanes « Features « Web Host Blog — Tue, 30 Mar 2010 21:25:26 +0000

[...] The mechanics of this – while not exactly rocket science – are not trivial either at this point. One needs an intermidiary piece of software to handle the mechnics of the backups and restore. You can read all the technical details of one person’s solution using S3 as a backup here: http://blog.eberly.org/2006/10/09/how-automate-your-backup-to-amazon-s3-using-s3sync/. [...]

By: Amazon S3 Backup script with encryption | *.hosting

Amazon S3 Backup script with encryption | *.hosting — Tue, 16 Feb 2010 20:36:41 +0000

[...] are already a few guides that show you how to implement s3sync on your [...]

By: Amedee Van Gasse

Amedee Van Gasse — Mon, 14 Dec 2009 10:52:10 +0000

Great article!
I’m going to adapt it a bit to my own needs, in combination with backup2l, and then I’ll write a detailed article about it on my blog. That will be in Dutch.

I’m also thinking about “bouncing” an EC2 server:
* start the EC2 server
* rsync from my machine to EC2
* copy the data from EC2 to S3
* shut down the EC2
Ideally it would take less than one hour to do this so it would only cost me a couple of cents per day (or per week) to run the EC2 and I could use the rsync protocol more efficiently.

By the way, you may want to delete some of the spam comments

By: Simon

Simon — Tue, 24 Nov 2009 11:44:59 +0000

Great article - thanks. Just to note that, in order to get s3sync to work, I had to make a small change to my s3config.rb to get it to check for the s3config.yml file in the local directory, as follows:- FROM: confpath = ["#{ENV['S3CONF']}", "#{ENV['HOME']}/.s3conf", "/etc/s3conf"] TO: confpath = ["./", "#{ENV['S3CONF']}", "#{ENV['HOME']}/.s3conf", "/etc/s3conf"] Hope this helps someone!

By: Emre Akkas

Emre Akkas — Fri, 13 Nov 2009 19:13:35 +0000

Thanks for the great post. I checked the s3sync readme as well but could not figure out how to monitor progress (I am not much of a Linux person). Is there a way to write the progress to a log file (what has been uploaded etc.)?

By: Managing Amazon S3 Online Storage with S3sync « Rforge

Managing Amazon S3 Online Storage with S3sync « Rforge — Sat, 31 Oct 2009 22:37:45 +0000

[...] John Eberly’s blog was an inspiration to get started. Follow the link to his excellent blog post. Possibly related posts: (automatically generated)Use Amazon S3 online storage as an extra harddisk with Googles s3fsManage Amazon S3 BucketsUsing the Directory Editor in EmacsUsing Amazon S3 via s3sync [...]

By: Anonymous

Anonymous — Wed, 23 Sep 2009 17:02:19 +0000

A high-frequency s3sync over a large number of files is costly in terms of LIST request.

By: Cheap Home Network Storage | gtuhl: startup technology

Cheap Home Network Storage | gtuhl: startup technology — Fri, 03 Jul 2009 11:12:29 +0000

[...] Setup a backup script that pushes select important items up to s3 each week. I used s3sync to do this but you can use whatever you like. s3sync is straight forward and easy to use in command line scripts. Here is the s3sync site and here is a blog post that describes usage well. [...]