3 ms·
S3 is eventually consistent, appending an eventually consistent file is going to get very messy, very fast - what happens when an append reaches a replica node
by EwanToo 11y ago
S3 is eventually consistent, appending an eventually consistent file is going to get very messy, very fast - what happens when an append reaches a replica node before an earlier one does?
If you're happy with out of order appends, just use a container file format like Parquet where appends are actually additional file creations