4 ms·
A few months back, I designed a small background system requiring a flat key/value store for tracking large amounts of data (>10GB/day). I was hoping to use S3
by seancoleman 7y ago
A few months back, I designed a small background system requiring a flat key/value store for tracking large amounts of data (>10GB/day). I was hoping to use S3 as a cheap key/value store, but the lack of batch operations, requiring individual puts, made it performance-prohibitive, so I went with DynamoDB. It's worked out great but I'll always wonder what could have been with S3 if I had batch operations back then.
- yazaddaruvala 7y agoThis is a different type of “batch”. You’re talking about API level batch calls. This is about simplifying workflows which rely on Listing every object in S3 and doing “something”.