4 ms·
You defintiely can use S3 for appending to a WAL (I've done it), they have read-after-write consistency
by dangoodmanUT 3y ago
You defintiely can use S3 for appending to a WAL (I've done it), they have read-after-write consistency
- ddorian43 3y agoYou're doing it for large OLAP writes. But as soon as you do OLTP or small writes it will become very slow & expensive. See warpstream as example https://news.ycombinator.com/item?id=37036291 https://news.ycombinator.com/item?id=37036291
- rowls66 3y agoHow about using Kafka for the WAL? Anybody tried that?
- ddorian43 3y agoLogDevice or apache bookeeper is better for distributed log.