4 ms·
It's more than just de-duplicating, tho. Imagine you query a dataset and get something like a page count and a chunk size. That page count cannot be trusted if
by ppeetteerr 6y ago
It's more than just de-duplicating, tho. Imagine you query a dataset and get something like a page count and a chunk size. That page count cannot be trusted if the dataset is mutable. If an item is inserted at the beginning of the set, you're going to miss the last item.
Pagination is hard
- the_arun 6y agoFor dynamic usecase, DynamoDB has implemented pagination with something called lastEvaluatedKey - https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Query.Pagination.html https://docs.aws.amazon.com/amazondynamodb/latest/developerg... This is different from LIMIT in RDBMS Wouldn’t this pattern solve the complexity you are talking about?
- ppeetteerr 6y agoThat's one way, for sure. You can do this with IDs, dates, etc.