Comments on: How I automated my backups to Amazon S3 using s3sync.

By: Amazon S3 Backup script with encryption | *.hosting

Amazon S3 Backup script with encryption | *.hosting — Tue, 16 Feb 2010 20:36:41 +0000

[...] are already a few guides that show you how to implement s3sync on your [...]

By: Amedee Van Gasse

Amedee Van Gasse — Mon, 14 Dec 2009 10:52:10 +0000

Great article!
I’m going to adapt it a bit to my own needs, in combination with backup2l, and then I’ll write a detailed article about it on my blog. That will be in Dutch.

I’m also thinking about “bouncing” an EC2 server:
* start the EC2 server
* rsync from my machine to EC2
* copy the data from EC2 to S3
* shut down the EC2
Ideally it would take less than one hour to do this so it would only cost me a couple of cents per day (or per week) to run the EC2 and I could use the rsync protocol more efficiently.

By the way, you may want to delete some of the spam comments

By: Simon

Simon — Tue, 24 Nov 2009 11:44:59 +0000

Great article - thanks. Just to note that, in order to get s3sync to work, I had to make a small change to my s3config.rb to get it to check for the s3config.yml file in the local directory, as follows:- FROM: confpath = ["#{ENV['S3CONF']}", "#{ENV['HOME']}/.s3conf", "/etc/s3conf"] TO: confpath = ["./", "#{ENV['S3CONF']}", "#{ENV['HOME']}/.s3conf", "/etc/s3conf"] Hope this helps someone!

By: Emre Akkas

Emre Akkas — Fri, 13 Nov 2009 19:13:35 +0000

Thanks for the great post. I checked the s3sync readme as well but could not figure out how to monitor progress (I am not much of a Linux person). Is there a way to write the progress to a log file (what has been uploaded etc.)?

By: Managing Amazon S3 Online Storage with S3sync « Rforge

Managing Amazon S3 Online Storage with S3sync « Rforge — Sat, 31 Oct 2009 22:37:45 +0000

[...] John Eberly’s blog was an inspiration to get started. Follow the link to his excellent blog post. Possibly related posts: (automatically generated)Use Amazon S3 online storage as an extra harddisk with Googles s3fsManage Amazon S3 BucketsUsing the Directory Editor in EmacsUsing Amazon S3 via s3sync [...]

By: Anonymous

Anonymous — Wed, 23 Sep 2009 17:02:19 +0000

A high-frequency s3sync over a large number of files is costly in terms of LIST request.

By: Cheap Home Network Storage | gtuhl: startup technology

Cheap Home Network Storage | gtuhl: startup technology — Fri, 03 Jul 2009 11:12:29 +0000

[...] Setup a backup script that pushes select important items up to s3 each week. I used s3sync to do this but you can use whatever you like. s3sync is straight forward and easy to use in command line scripts. Here is the s3sync site and here is a blog post that describes usage well. [...]

By: links for 2009-05-14 « Where Is All This Leading To?

links for 2009-05-14 « Where Is All This Leading To? — Fri, 15 May 2009 00:07:05 +0000

[...] John Eberly » How I automated my backups to Amazon S3 using s3sync. (tags: webservices amazons3 amazon ec2 s3 backups admin reference sysadmin backup rsync sync aws automation ruby data server mac tools tutorial blog article software howto online todo storage ubuntu linux s3sync) [...]

By: Amazon S3 | I-Tek

Amazon S3 | I-Tek — Wed, 29 Apr 2009 15:47:00 +0000

[...] How I automated my backups to Amazon S3 using s3sync Dit was geschreven door Herman. Geplaatst op dinsdag, 28 april 2009, at 21:15. Opgeslagen onder WebTek. Tagged Blog, internet, mobiel, sync, toepassing, web 2.0, WordPress. Bookmark de permalink. Volg commentaar via de RSS feed. Plaats een reactie of plaats een trackback. [...]

By: svittal

svittal — Mon, 27 Apr 2009 17:06:46 +0000

I’m trying to sync /var/log to S3.
There are few files in /var log which belong to ’syslog.adm’
I see files owned by root.root is begin transferred without any problem. files owned by syslog.adm is not moved.

any idea why?