2 ms·
Reading the article it’s clear pretty quickly that Uber was using DynamoDB poorly. It seems they need strong consistency for certain CUJs and then a lot of dat
by yazaddaruvala 2y ago
Reading the article it’s clear pretty quickly that Uber was using DynamoDB poorly.
It seems they need strong consistency for certain CUJs and then a lot of data warehousing for historical transactions.
It’s strange to me that they didn’t first convert their 2 table DynamoDB architecture into DynamoDB and Redshift architecture or similar. This is a pretty common pattern.
- PartiallyTyped 2y agoI don't understand why they needed 2 weeks of immutable transactions in Dynamo. Could anyone give any hints?
- cced 2y agoCan you post some references to this pattern?
- yazaddaruvala 2y agoMostly just look into “archiving into data warehouse” type patterns. You can also look into “realtime data warehousing”. Meanwhile, it’s so common, AWS built it into their product. https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-dynamodb-zero-etl-integration-redshift/ https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-dy...