adam at RFXTechnologies
Mar 22, 2011, 1:02 PM
Post #8 of 14
I used this page heavily for tips on getting it all working: http://code.google.com/p/s3fs/wiki/FuseOverAmazon
Linux 2.6.26-2-686 #1 SMP Thu Sep 16 19:35:51 UTC 2010 i686 GNU/Linux
Fuse: libfuse-dev_2.8.4-1.1_i386, libfuse2_2.8.4-1.1_i386
My fstab looks like this:
s3fs#shared.rfxwebsites.com /mnt/s3fs/shared.rfxwebsites.com fuse use_rrs=1,allow_other,nonempty,uid=www-data,gid=www-data,rw,auto,default_acl=public-read 0 0
I set up an additional mount for each website that we host that is related to a bucket on Amazon's S3 architecture.
Let me know if you have any more questions, I am happy to share my limited knowledge when I can.
From: John Durkin [mailto:john [at] j2d3]
Sent: Tuesday, March 22, 2011 12:09 PM
To: Adam Wilson
Cc: users [at] lists
Subject: Re: New amazon S3 mover
oh, that's encouraging to hear the fuse mount is working for you... version of fuse are you using, and on what platform? what version of s3fs?
On Tue, Mar 22, 2011 at 8:23 AM, Adam Wilson <adam [at] rfxtechnologies<mailto:adam [at] rfxtechnologies>> wrote:
For the time being, we are using the filesystem mover with a fuse mount without any issues. I haven't had any issues that I have noticed with this approach, but I only just implemented this a couple of weeks ago, perhaps there are issues I am just unaware of.
I started looking into creating the new mover, but I was immediately overwhelmed by the task at hand. I am planning on using the Net::Amazon::S3,as David stated, but I am not the best perl programmer and it is going to take some time to get anything close to as sophisticated as the existing movers in place. I will keep the thread informed as I make progress though. It will help to motivate me to know that I am not the only one interested in this capability.
From: John Durkin [mailto:john.durkin [at] gmail<mailto:john.durkin [at] gmail>]
Sent: Monday, March 21, 2011 3:12 PM
To: users [at] lists<mailto:users [at] lists>
Cc: Adam Wilson
Subject: Re: New amazon S3 mover
Any progress with this? I'm going to be making one as well. Was trying to just use the filesystem mover with a fuse mount (s3fs - fuse) - but s3fs can't handle the way perl is trying to save files (and create directory structure), so that's out.
On Thu, Mar 10, 2011 at 9:04 AM, David E. Wheeler <david [at] kineticode<mailto:david [at] kineticode>> wrote:
On Mar 10, 2011, at 8:34 AM, Adam Wilson wrote:
> First question, anyone already built an Amazon S3 mover for Bricolage that they are willing to share?
> If not, I might give it a whirl. Looks like it is probably way over my head, but I used to say that about Perl, and now I can print a pretty mean "Hello World" page. I see the directions on how to add the mover here -> http://bricolagecms.org/docs/current/api/?Bric::Dist::Action::Mover, is there anywhere else I might look for additional tips and tricks?
Just look at the code in the other movers.
> Is there also a way to add additional parameters to either the Server Profile or to the Destination Profile? It would be really nice to be able to add a set of properties on the Server Profile page based on the type of Move Method specified in the Destination Profile.
> I suppose lacking this, I will also need to figure out how look up values in bricolage.conf.
Yes. See the email mover.