Stack Overflow
Stack Overflow

Questions tagged [amazon-s3]

Amazon S3 (simple storage service) is an online object storage service from Amazon Web Services. QUESTIONS MUST BE ABOUT PROGRAMMING. Questions about general S3 support, functionality, configuration, etc. are OFF-TOPIC.

Amazon S3 (Simple Storage Service) is an online storage web service offered by Amazon Web Services. Amazon S3 provides storage through a simple web services interface. It gives any developer access to the same highly scalable, reliable, secure, fast, inexpensive infrastructure that Amazon uses to run its own global network of web sites.

References

Tutorials

40910 questions
826
votes
31 answers

Downloading an entire S3 bucket?

I noticed that there doesn't seem to be an option to download an entire S3 bucket from the AWS Management Console. Is there an easy way to grab everything in one of my buckets? I was thinking about making the root folder public, using wget to grab…
rugbert
  • 9,753
  • 9
  • 35
  • 60
352
votes
13 answers

AWS EFS vs EBS vs S3 (differences & when to use?)

As per the title of this question, what are the practical differences between AWS EFS, EBS and S3? My understanding of each: S3 is a storage facility accessible any where EBS is a device you can mount onto EC2 EFS is a file system you can mount…
Integralist
  • 5,121
  • 3
  • 21
  • 34
299
votes
2 answers

Make a bucket public in Amazon S3

How can I set a bucket in Amazon S3 so all the files are publicly read-only by default?
Victor
  • 20,476
  • 27
  • 76
  • 108
272
votes
13 answers

S3 Static Website Hosting Route All Paths to Index.html

I am using S3 to host a javascript app that will use HTML5 pushStates. The problem is if the user bookmarks any of the URLs, it will not resolve to anything. What I need is the ability to take all url requests and serve up the root index.html in my…
Mark Nutter
  • 4,859
  • 4
  • 13
  • 12
260
votes
17 answers

Listing contents of a bucket with boto3

How can I see what's inside a bucket in S3 with boto3? (i.e. do an "ls")? Doing the following: import boto3 s3 = boto3.resource('s3') my_bucket = s3.Bucket('some/path/') returns: s3.Bucket(name='some/path/') How do I see its contents?
Amelio Vazquez-Reina
  • 74,000
  • 116
  • 321
  • 514
259
votes
12 answers

Setting up FTP on Amazon Cloud Server

I am trying to set up FTP on Amazon Cloud Server, but without luck. I search over net and there is no concrete steps how to do it. I found those commands to run: $ yum install vsftpd $ ec2-authorize default -p 20-21 $ ec2-authorize default -p…
SharkTheDark
  • 3,049
  • 4
  • 21
  • 28
255
votes
10 answers

When to use Amazon Cloudfront or S3

Are there use cases that lend themselves better to Amazon cloudfront over s3 or the other way around? I'm trying to understand the difference between the 2 through examples.
Kamo
  • 3,027
  • 2
  • 17
  • 20
252
votes
20 answers

How to rename files and folder in Amazon S3?

Is there any function to rename files and folders in Amazon S3? Any related suggestions are also welcome.
Shan
  • 2,712
  • 2
  • 11
  • 15
232
votes
6 answers

Security of REST authentication schemes

Background: I'm designing the authentication scheme for a REST web service. This doesn't "really" need to be secure (it's more of a personal project) but I want to make it as secure as possible as an exercise/learning experience. I don't want to use…
dF.
  • 67,375
  • 27
  • 125
  • 135
223
votes
28 answers

S3 - Access-Control-Allow-Origin Header

Did anyone manage to add Access-Control-Allow-Origin to the response headers? What I need is something like this:
Wowzaaa
  • 3,000
  • 4
  • 18
  • 23
222
votes
23 answers

check if a key exists in a bucket in s3 using boto3

I would like to know if a key exists in boto3. I can loop the bucket contents and check the key if it matches. But that seems longer and an overkill. Boto3 official docs explicitly state how to do this. May be I am missing the obvious. Can anybody…
Prabhakar Shanmugam
  • 3,916
  • 5
  • 20
  • 30
211
votes
15 answers

AWS S3: The bucket you are attempting to access must be addressed using the specified endpoint

I am trying to delete uploaded image files with the AWS-SDK-Core Ruby Gem. I have the following code: require 'aws-sdk-core' def pull_picture(picture) Aws.config = { :access_key_id => ENV["AWS_ACCESS_KEY_ID"], :secret_access_key…
user3575214
  • 2,347
  • 2
  • 10
  • 13
196
votes
6 answers

Serving gzipped CSS and JavaScript from Amazon CloudFront via S3

I've been looking for ways of making my site load faster and one way that I'd like to explore is making greater use of Cloudfront. Because Cloudfront was originally not designed as a custom-origin CDN and because it didn't support gzipping, I have…
Donald Jenkins
  • 3,425
  • 7
  • 30
  • 34
189
votes
9 answers

AWS Error Message: A conflicting conditional operation is currently in progress against this resource

I'm getting this error intermittently. I have a program that uses the java aws sdk and loads over the 10s of thousands of small files to s3. I see this error intermittently. Could not find any helpful answer after doing a quick search on the…
user1172468
  • 4,910
  • 6
  • 29
  • 56
179
votes
4 answers

Amazon S3 - HTTPS/SSL - Is it possible?

I saw a few other questions regarding this without any real answers or information (or so it appeared). I have an image here: http://furniture.retailcatalog.us/products/2061/6262u9665.jpg Which is redirecting…
Kerry Jones
  • 21,388
  • 11
  • 58
  • 87
1
2 3
…
99 100