3 ms·
"The write path. We built a daemon that would select log entries that were older than two weeks, copy them into a file in S3, and delete the rows from the datab
by bsaul 4y ago
"The write path. We built a daemon that would select log entries that were older than two weeks, copy them into a file in S3, and delete the rows from the database"
Seriously... How can you ever consider saying "a rdbms is just fine as a kafka alternative" under those conditions ?
- peterhunt 4y agoWhy not?
- bsaul 4y agoBecause that would be equivalent to saying « rdbms are fine as a kafka alternative provided you build a compensation mechanism for all the things it does worse than kafka». It doesn’t make any sense.
- andrewstuart 4y agoIdeology. There's alot of people who are ideologically opposed to database backed message queues. They're usually reluctant to give detailed explanations why, because it's an emotional thing.
- xupybd 4y agoHow does Kafka solve this problem any better? Your messages expire so if you want to archive you need a consumer to write them to disk. That sounds very similar.