Stack Overflow
Stack Overflow

Questions tagged [s3fs]

s3fs is a FUSE filesystem which allows to mount an Amazon S3 bucket as a local filesystem.

s3fs allows Linux and macOS to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like s3cmd.

s3fs is stable and is being used in number of production environments, e.g., rsync backup to s3.

Important Note: Your kernel must support FUSE, kernels earlier than 2.6.18-164 may not have FUSE support (see issue #140 ). Virtual Private Servers (VPS) may not have FUSE support compiled into their kernels.

There is also a Python library called s3fs. For questions related to this library, please use .

194 questions
0
votes
1 answer

Fstab cache seems funky, filling up

We have an Amazon Server with an S3 mounted partition. I like to think the mount is working, but the directory specified under the use_cache directive is filling up very rapidly, and is not shrinking back down, is this normal? The config in fstab…
Mike
  • 1,769
  • 15
  • 34
0
votes
3 answers

AWS s3fs - CentOS 6.4

I have successfully installed s3fs from google code http://code.google.com/p/s3fs/downloads/list I have configured and created a mount point in the system, my mount point is: /mnt/aws the problem is that it mount correctly but if I do the…
Marcos Lamba
  • 329
  • 2
  • 5
  • 9
0
votes
1 answer

how to get width/ height of video file using S3FS, FFMPEG in ec2

at the moment I succeed to install S3FS & FFMPEG in ec2, but i don't know why I can't get information about height and width of a video file, but another properties such as duration, audio stream, etc are shown, I already try in local within same a…
Khalid
  • 829
  • 2
  • 12
  • 25
0
votes
1 answer

Can I use s3fs cache for Nginx?

I’m using s3fs for Web contents storage. Its mount point is /data/example.com/. The s3fs cache path is /data/cache/example.com/. My Nginx currently uses /data/example.com/ for the document root. I want to change this to /data/cache/example.com, but…
kuwa
  • 1
  • 2
0
votes
1 answer

s3fs permissions for s3 directory

I'm trying to mount the s3 directory to my EC2 instance. I'm getting everything to work except my user is not able to write to the mounted directory. I even ran with the allow_other permission set. Is there something else? I created the directory…
KVISH
  • 12,097
  • 15
  • 79
  • 151
0
votes
1 answer

different permissions for same amazon s3fs bucket mounted on 2 different instances?

I am mounting the same amazon bucket on 2 different Ubuntu server instances but ubuntu user can only write on the first one not the second. On the second one it has reading rights but not writing. I am using this command to mount them: s3fs -o…
Delcasda
  • 372
  • 4
  • 13
0
votes
1 answer

Understanding storage requirement for amazon s3 using fuse-s3fs

I got a question to understand the mount process of Amazon s3 service suing fuse-s3fs, when i mount amazon s3 service bucket, does it copies whole data to my local system or it will just act as view of amazon s3 bucket? The reason why i want to know…
Saqlain
  • 15,990
  • 4
  • 25
  • 33
0
votes
1 answer

Placing the contents from s3 to my file system?

I have been trying to push the files in s3 to my ec2 instance. When I do so : sudo s3fs -o allow_other -o default_acl="public-read" files /home/logs It doesn't give any error. But when I tried to look into the logs directory. I couldn't able to…
sriram
  • 7,077
  • 18
  • 54
  • 78
0
votes
1 answer

How to copy files and directories to EBS from a S3 bucket mount with s3fs

I have a S3 bucket mount as a volume in one EC2 instance with S3FS. I've created with PHP a directory structure there with more than 20GB now. By the moment S3FS is exhausting instance memory and uploading is really slow so I want to move all the…
hernangarcia
  • 544
  • 2
  • 6
  • 13
0
votes
1 answer

EC2 to S3 - Amazon

I am running Adobe Media Server 5 on a EC2 machine and I also have a recording application that saves .flv file to the default AMS folder, I`d like to send all recorded files to S3 as soon as they get to the folder. Since we are using RTMP, I need…
Jeff
  • 45
  • 1
  • 8
0
votes
1 answer

Very slow connection between EC2 and S3. Is it normal?

I am trying to setup CDN for my website. So, this is what I did: Created S3 bucket Created CloudFront distribution based on this test bucket Mounted my test s3 bucket on my ec2 instance using following command: /usr/bin/s3fs -o allow_other…
Kelvin
  • 8,012
  • 8
  • 33
  • 34
0
votes
3 answers

make file not working for s3fs

Hi i am trying to install s3fs but i am getting the following error. *** No targets specified and no makefile found. Stop. any ideas i am following the installation tutorial http://code.google.com/p/s3fs/wiki/InstallationNotes heres my terminal…
DCHP
  • 1,101
  • 6
  • 28
  • 53
-1
votes
1 answer

Mount a bucket using S3FS doesn't work as non-root user

I'm trying to mount an Exoscale bucket to an Exoscale VM running Ubuntu 20.04 using s3fs as the ubuntu user created by default by Exoscale. After reading the s3fs README and a few online tutorials here what I have done. # install s3fs sudo apt-get…
Sig
  • 4,674
  • 8
  • 39
  • 65
-2
votes
1 answer

Can we mount s3 bucket which already has some files and directories in it using S3FS?

Am trying to mount S3 bucket with some data to an EC2 instance. Am not getting any error, but df -h is not showing it as mounted. Can you suggest any other better open source software for the same operation. I want to mount S3 bucket with lots of…
aAAAAAAa
  • 125
  • 1
  • 2
  • 9
1 2 3
…
12
13