Use: Our users have many objects in our AWS S3 account. We are adding a feature to download entire projects at once. We are more concerned with efficiency than with storage.
After looking at different options (ZipArchive, PclZip) I came across this guide recommending the use of Chilkat.
It's method makes a lot of sense, and summarized it is as follows:
- Prezip each file on upload and store it in S3
- "Project Download" starts downloading each compressed file then QuickAppend (Chilkat terminology) which then "instantly" (200ms per file) adds them to the overall compressed file
- Upload new Zip file to S3, provide link
The issue I am running into is a license for Chilkat is $249, and I am looking for free alternatives.
An alternative (also free) uses a similar concept:
- Prezip each file on upload and store it in S3
- "Project Download" starts downloading each compressed file then tar's them together
- Upload new Zip file to S3, provide link
Is there a "standard" or "ideal" way for dealing with this?