Stack Overflow
Stack Overflow

Questions tagged [amazon-s3]

Amazon S3 (simple storage service) is an online object storage service from Amazon Web Services. QUESTIONS MUST BE ABOUT PROGRAMMING. Questions about general S3 support, functionality, configuration, etc. are OFF-TOPIC.

Amazon S3 (Simple Storage Service) is an online storage web service offered by Amazon Web Services. Amazon S3 provides storage through a simple web services interface. It gives any developer access to the same highly scalable, reliable, secure, fast, inexpensive infrastructure that Amazon uses to run its own global network of web sites.

References

Tutorials

40910 questions
10
votes
1 answer

Import data from URL to Amazon S3

I have a file with a pre-signed URL. I would like to upload that file directly to my S3 bucket without donwloading it first (I know how to do it with the intermediate step but I want to prevent it). Any suggestion? Thanks in advance
desmo
  • 133
  • 1
  • 10
10
votes
4 answers

Grant S3 access to Elastic Beanstalk instances

I'm trying to provision my EC2 instances in Elastic Beanstalk with some ssh keys from a private S3 bucket. Here's a snippet of my .ebextensions/.config: files: "/root/.ssh/id_rsa" : mode: "000400" ownder: root group: root source:…
jamstooks
  • 1,035
  • 2
  • 11
  • 19
10
votes
3 answers

In what geographical region is my S3 bucket stored?

I have created an Amazon Web Services S3 bucket in the past, without specifying the geographic region for it to be stored in. How do I determine which region the bucket is located in? My reason for asking, is that I am preparing to run some "Amazon…
Jørn Schou-Rode
  • 35,883
  • 13
  • 81
  • 120
10
votes
1 answer

How can I sync two amazon buckets using the AWS CLI?

I'm using the AWS S3 CLI to sync two buckets, following the Amazon CLI S3 SYNC format specified in the documentation, as follows: aws s3 sync s3://source_bucket s3://target_bucket --exclude *.tmp Bug I get the following error: A region must be…
Jasper33
  • 447
  • 1
  • 6
  • 18
10
votes
1 answer

Is there a max limit of buckets that a Google Cloud Storage project can have?

Amazon S3 has a limit of 100 buckets per account: http://docs.aws.amazon.com/AmazonS3/latest/dev/BucketRestrictions.html Does Google Cloud Storage have any such limits? I cannot find any mention of them... but wanted to know before I made a…
Nick Franceschina
  • 5,469
  • 6
  • 32
  • 50
10
votes
1 answer

S3 bucket policy: In a Public Bucket, make a sub-folder private

I have a bucket filled with contents that need to be mostly public. However, there is one folder (aka "prefix") that should only be accessible by an authenticated IAM user. { "Statement": [ { "Sid": "AllowIAMUser", "Action": [ …
SunSparc
  • 1,672
  • 2
  • 20
  • 45
10
votes
1 answer

Paperclip attachment not using proper updated_at time for query string

I'm using Rails + Paperclip + S3. I'm looking to host my assets to Cloudfront using one of my S3 buckets. I know that Cloudfront caches assets but that you can break that cache by configuring it to forward query strings from the origin. When I…
johnnymire
  • 1,063
  • 1
  • 11
  • 25
10
votes
1 answer

Upload file to S3 using CarrierWave without a model, is it possible?

CarrierWave has amazing documentation, until you need to do it without a model! I have my uploader and fog settings set up, and they all work fine when using the mounted uploader on a model, but now I want to do it without a model. I have this: …
andy
  • 8,165
  • 12
  • 71
  • 120
10
votes
2 answers

Set proper endpoint in for S3 Client in Amazon AWS PHP SDK

I'm trying to use the AWS SDK for PHP to programatically upload a file to a bucket that's set to be a static website in the S3 Console. The bucket is named foo.ourdomain.com and is hosted in eu-west. I'm using the following code to try and test if I…
Marlies
  • 919
  • 1
  • 5
  • 17
10
votes
2 answers

Amazon S3 Object Replication

Folks, I may be reading things different, however I've been under the impression that objects and buckets in us-east do NOT get replicated automatically to us-west... However, reading the documentation, I see 2 conflicting statements: From…
Cmag
  • 12,570
  • 23
  • 75
  • 129
10
votes
3 answers

How to set Content-Disposition Headers as a default on Amazon S3 Bucket

The problem I have is that I need the Content-Disposition: attachment header to be present on EVERY file that hits my bucket. In Wordpress, I can just use .htaccess to cover the filetypes in question (videos), but those rules do not extend to my S3…
Garrett
  • 447
  • 2
  • 4
  • 19
10
votes
3 answers

Boto S3 throws httplib.IncompleteRead occasionally

I have several daemons that read many files from Amazon S3 using boto. Once every couple of days, I'm running into a situation where an httplib.IncompleteRead is thrown out from deep inside boto. If I try and retry the request, it immediately fails…
wolak
  • 709
  • 6
  • 16
10
votes
2 answers

upload file from angularjs directly to amazon s3 using signed url

So I am having some trouble uploading a file directly to S3. Currently my process is to make a request to nodejs/express to get a signed URL. app.post('/s3SignedURL', function(req, res){ var id = crypto.randomBytes(20).toString('hex'); var ext =…
nbppp2
  • 185
  • 1
  • 3
  • 11
10
votes
1 answer

Access Denied when uploading files to Amazon using Paperclip and IAM policies

I am unable to get an upload working with Paperclip using an S3 IAM policy. I'm even having issues with direct jQuery uploads (no Paperclip). My scenario is as follows, I have an application that will have many sites. Each site will have it's own…
Ryan Arneson
  • 1,293
  • 3
  • 14
  • 25
10
votes
2 answers

CORS Amazon S3 file upload with jQuery Ajax request

I have scanned almost everything now and most people they're solution was simply to configure CORS on the S3 service, which doesn't do the trick for me. I must be missing something. Here it goes: I'm trying to upload my files to Amazon S3 using an…
Acek
  • 133
  • 1
  • 9
1 2 3
…
99
100