How small are the files? Here are some strategies to make S3 go faster: https://news.ycombinator.com/item?id=19475726 https://news.ycombinator.com/item?id=1947

How small are the files? Here are some strategies to make S3 go faster: https://news.ycombinator.com/item?id=19475726 https://news.ycombinator.com/item?id=19475726 -- You're right that S3 isn't for small files but for a lot of small files (think 500 bytes), I either plunge them to S3 through Kinesis Firehose or fit them gzipped into DynamoDB (depending on access patterns). One could also consider using Amazon FSx which can IO to S3 natively.