Low upload speeds with S3 as primary storage¶

If you have S3 as primary storage, and upload a file, and see that the speed is peaking at low speeds (e.g. 10 MB) then this article is for you.

When uploading trough the web interface, files are uploaded in chunks before being reassembled in a final request. Unfortunately, with primary s3 storage this currently means that each chunk gets uploaded to the s3 bucket, before then downloading all chunks again for reassembly and uploading the result, creating a fairly large overhead while uploading large files.

Solution¶