Stack Overflow
Stack Overflow

Questions tagged [s3fs]

s3fs is a FUSE filesystem which allows to mount an Amazon S3 bucket as a local filesystem.

s3fs allows Linux and macOS to mount an S3 bucket via FUSE. s3fs preserves the native object format for files, allowing use of other tools like s3cmd.

s3fs is stable and is being used in number of production environments, e.g., rsync backup to s3.

Important Note: Your kernel must support FUSE, kernels earlier than 2.6.18-164 may not have FUSE support (see issue #140 ). Virtual Private Servers (VPS) may not have FUSE support compiled into their kernels.

There is also a Python library called s3fs. For questions related to this library, please use .

194 questions
3
votes
1 answer

Why can't I write to the encfs folder as its owner?

I'd like to mount s3fs to an AWS S3 bucket, encrypt the contents in the S3 bucket using encfs and write to the bucket (eg copy a file to the bucket) as ec2-user (ie. not using sudo). I cannot copy a file as the ec2-user and I have to use sudo but…
Roobie
  • 1,136
  • 4
  • 11
  • 21
3
votes
1 answer

Mounting a S3 bucket using s3fs utility AWS

I am using s3fs utility to mount a S3 bucket on an EC2 instance. After crossing so much hurdles I am able to mount the S3 bucket. I have few queries : If I mount a S3 bucket on EC2 instance do I need to make any entry to the fstab. If I mount a S3…
user3086014
  • 3,547
  • 5
  • 25
  • 50
3
votes
2 answers

Mount S3 (s3fs) on EC2 with dynamic files - Persistent Public Permission

Using S3FS and FUSE to mount a S3 bucket to an AWS EC2 instance, I encountered a problem whereby my S3 files are being updated, but the new files doesn't adopt the proper permission. The ACL rights that the new files had were "---------" instead of…
George
  • 5,648
  • 5
  • 43
  • 63
3
votes
1 answer

S3FS inside LXC containers mounted by the host

I'm currently using several LXC containers to isolate other users' programs from the host system. The rootfs of each container uses a union file system and a few mount-binds from the host and everything is working correctly. Now I want to be able to…
jlhawn
  • 343
  • 1
  • 3
  • 8
3
votes
3 answers

How to mount a Amazon S3 bucket by using FUSE - S3FS

This is driving me up the wall. I am still a little new to Linux but i do understand how to do most of day to day stuff I need to do. What I am trying to do is mount a Amazon S3 bucket to a mount point on my server. I running Ubuntu server 12.04, it…
Glenn Curtis
  • 639
  • 1
  • 14
  • 32
2
votes
3 answers

s3fs mount error: specified passwd_file is not readable

I am trying to port ftp server on linux ec2 instance. Password authentication file exists in /etc/passwd-s3fs with permission 600. But when I run command: $ s3fs bucketname /home/s3/s3mnt -o passwd_file=/etc/passwd-s3fs,nonempty It shows below…
Bhushan Tembhurne
  • 41
  • 3
2
votes
1 answer

Duplicate on both S3 and EC2 after mounting

I created S3 bucket and mounted with ec2. When I upload a file to S3 bucket, that file is copied to ec2 mounted folder automatically. I wanted the file to be uploaded to S3 bucket only. As it copies to EC2 folder, it becomes redundant and doesn't…
Wasim
  • 1,116
  • 10
  • 25
2
votes
1 answer

Sync big data from droplet to Digital Ocean Space (S3)

My web project static folder's size is around 10 GB and it is stored in Digital Ocean Droplet. Today I tried out Digital Ocean Space and idea was to copy and sync all my storage files to the new space. My first approach started from mounting folder.…
Rashad
  • 1,265
  • 2
  • 16
  • 31
2
votes
0 answers

Mount S3 bucket to ec2 instance using S3FS

When running the following mount command I get a unable to access MOUNTPOINT url=https://s3-us-gov-west-1.amazonaws.com: no such file or directory. I get the same error when using endpoint=us-gov-west-1 instead of url s3fs your_bucketname -o…
Morgan Gladden
  • 373
  • 2
  • 12
2
votes
1 answer

Tracking down S3 Costs (S3FS)

During a transition, our S3 costs jumped a lot due to ListBucket and HeadObject calls. We are trying to figure out how to debug a sudden increase in our S3 costs. We made some changes that should NOT have affected it but the major change seems to…
Chris Go
  • 559
  • 5
  • 16
2
votes
1 answer

Can I use a docker volume with S3FS?

I would like to have a shared directory between my containers: ftp and s3fs. Todo so, I have created a volume in my docker-compose file called s3. If I stop s3fs from running in my s3fs container, then I can create files in the ftp container and…
Freid001
  • 1,723
  • 1
  • 17
  • 38
2
votes
0 answers

Create an S3 FTP server with s3fs+vsftpd error 500

in my project i have to run an Linux EC2 instance like an FTP server connected to my S3 bucket directly. After installing s3fs+fuse, vsftpd and all dependencies, configuring the conf files correctly, i do this: First i create my folder fo ftp…
AleMal
  • 1,721
  • 2
  • 23
  • 41
2
votes
0 answers

AWS S3 as Docker volume?

I'm trying to set up a Gitlab CI Pipeline using Docker on AWS EC2. Everything worked as expected until I hit the storage cap on my EC2 instance (8GB). As I quickly learn, a pipeline could easily use up 1-2 GB of data. Having 4 on the server and…
Hieu Nguyen
  • 31
  • 7
2
votes
0 answers

Cannot make a directory through php inside mounted s3 bucket

I have successfully mounted the s3 with the -o allow_other option and also having allow_other enabled in my fuse.conf file. Inside my bucket I have 2 directories. I am using Laravel and I am trying to copy images inside my bucket and arranging them…
Marius Stanciu
  • 165
  • 1
  • 11
2
votes
4 answers

s3fs_check_service: invalid credentials - result of checking service

I am using s3fs for mounting wrt to s3 bucket My S3 bucket is AES256 Encrypted The mount command is s3fs -o dbglevel=info -o allow_other -o use_sse=1 -o use_cache=/tmp bucketname /s3mnt Doing so I don't get any error message, but the mount is not…
Saravanan D
  • 31
  • 5
1 2
3
…
12 13