Comments on: How I automated my backups to Amazon S3 using rsync and s3fs. http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/ Tue, 16 Feb 2010 20:36:41 -0500 http://wordpress.org/?v=2.8.4 hourly 1 By: Matt Wilson http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-71584 Matt Wilson Mon, 25 Jan 2010 17:09:45 +0000 http://blog.eberly.org/?p=93#comment-71584 I realized Amazon announced a new pricing (or was there and I never noticed before) that charges for PUTs and GETs on your account. My question is that did anybody notice a huge bill because of using rsync? I realized Amazon announced a new pricing (or was there and I never noticed before) that charges for PUTs and GETs on your account. My question is that did anybody notice a huge bill because of using rsync?

]]> By: Matt Wilson http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-71583 Matt Wilson Mon, 25 Jan 2010 17:00:20 +0000 http://blog.eberly.org/?p=93#comment-71583 <a href="#comment-60957" rel="nofollow">@Jacob</a> I had same situation with my setup and I may not recommend doing what I did because I was just testing. I simply went on S3Fox and deleted nameholder for the empty folder name, then the real folder surfaced and now I can navigate through contents of it. So use it on your risk, possible test it first. @Jacob
I had same situation with my setup and I may not recommend doing what I did because I was just testing. I simply went on S3Fox and deleted nameholder for the empty folder name, then the real folder surfaced and now I can navigate through contents of it. So use it on your risk, possible test it first.

]]> By: Ditching the custom wheel in backups - The Blog http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-71207 Ditching the custom wheel in backups - The Blog Sat, 16 Jan 2010 11:03:18 +0000 http://blog.eberly.org/?p=93#comment-71207 [...] around for information on how other people were handling this.The PlanI came across a post from John Eberly discussing how he automates his backups to amazon s3. This looked like a good place to start but I [...] [...] around for information on how other people were handling this.The PlanI came across a post from John Eberly discussing how he automates his backups to amazon s3. This looked like a good place to start but I [...]

]]> By: tnorup http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-69207 tnorup Thu, 03 Dec 2009 21:45:09 +0000 http://blog.eberly.org/?p=93#comment-69207 When make'ing s3fs on Ubuntu Karmic I got this error: ------------------- Package fuse was not found in the pkg-config search path. Perhaps you should add the directory containing `fuse.pc' to the PKG_CONFIG_PATH environment variable No package 'fuse' found Package libcurl was not found in the pkg-config search path. Perhaps you should add the directory containing `libcurl.pc' to the PKG_CONFIG_PATH environment variable No package 'libcurl' found ------------------------ The cure was: apt-get install build-essential libcurl4-openssl-dev libxml2-dev libfuse-dev When make’ing s3fs on Ubuntu Karmic I got this error:

——————-
Package fuse was not found in the pkg-config search path.
Perhaps you should add the directory containing `fuse.pc’
to the PKG_CONFIG_PATH environment variable
No package ‘fuse’ found
Package libcurl was not found in the pkg-config search path.
Perhaps you should add the directory containing `libcurl.pc’
to the PKG_CONFIG_PATH environment variable
No package ‘libcurl’ found
————————

The cure was:

apt-get install build-essential libcurl4-openssl-dev libxml2-dev libfuse-dev

]]> By: links for 2009-11-05 « Where Is All This Leading To? http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-67537 links for 2009-11-05 « Where Is All This Leading To? Fri, 06 Nov 2009 00:31:23 +0000 http://blog.eberly.org/?p=93#comment-67537 [...] John Eberly » How I automated my backups to Amazon S3 using rsync and s3fs. (tags: linux server webservices webservice amazons3 sync cloud mount aws fuse s3fs ubuntu sysadmin s3 amazon reference software tutorial storage backup rsync mac howto) [...] [...] John Eberly » How I automated my backups to Amazon S3 using rsync and s3fs. (tags: linux server webservices webservice amazons3 sync cloud mount aws fuse s3fs ubuntu sysadmin s3 amazon reference software tutorial storage backup rsync mac howto) [...]

]]> By: Jason http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-66592 Jason Fri, 23 Oct 2009 18:06:10 +0000 http://blog.eberly.org/?p=93#comment-66592 Got this working just fine. Thanks for the article! I would like to know if anyone knows of a way to hit "directories" that are inside a bucket? Got this working just fine. Thanks for the article!

I would like to know if anyone knows of a way to hit “directories” that are inside a bucket?

]]> By: Diagnosing a Linux problem | Save every Moment,duh! http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-64433 Diagnosing a Linux problem | Save every Moment,duh! Wed, 09 Sep 2009 12:38:10 +0000 http://blog.eberly.org/?p=93#comment-64433 [...] was trying to backup my debian server using this s3fs script but apparently I forgot that the script needs fuse in the kernel. Since I just upgraded my kernel to [...] [...] was trying to backup my debian server using this s3fs script but apparently I forgot that the script needs fuse in the kernel. Since I just upgraded my kernel to [...]

]]> By: Andy http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-63680 Andy Fri, 21 Aug 2009 05:32:52 +0000 http://blog.eberly.org/?p=93#comment-63680 Want to learn a new way to backup the data to S3? Try CloudBerry Backup. It is powered by Amazon S3 reliable and cost efficient storage. If you want to take part in beta sign up on the website http://cloudberrydrive.com What safer place to keep your files than Amazon's servers? Want to learn a new way to backup the data to S3? Try CloudBerry Backup. It is powered by Amazon S3 reliable and cost efficient storage. If you want to take part in beta sign up on the website http://cloudberrydrive.com What safer place to keep your files than Amazon’s servers?

]]> By: Jack http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-63262 Jack Thu, 13 Aug 2009 02:30:50 +0000 http://blog.eberly.org/?p=93#comment-63262 Oh and a rename or move in the same file system does not normally move the data, only updates the directory information. Oh and a rename or move in the same file system does not normally move the data, only updates the directory information.

]]> By: Jack http://blog.eberly.org/2008/10/27/how-i-automated-my-backups-to-amazon-s3-using-rsync/comment-page-1/#comment-63260 Jack Thu, 13 Aug 2009 02:29:08 +0000 http://blog.eberly.org/?p=93#comment-63260 Not really. Normally it is MOVED and not copied the 'second' time. So only if it moves over to another file system, would it be copied. And in S3, it looks like one single file system for all practical purposes. Not really. Normally it is MOVED and not copied the ’second’ time. So only if it moves over to another file system, would it be copied. And in S3, it looks like one single file system for all practical purposes.

]]>