3 ms·
The issue is that fsync is super expensive. Like, it's not even funny. There are many cases, and ingest is one of them, where no being durable is fine. If you
by ayende 3y ago
The issue is that fsync is super expensive.
Like, it's not even funny.
There are many cases, and ingest is one of them, where no being durable is fine.
If you can either:
* Repeat the whole process on failure (which is assumed to be rare)
* Recover from the failure without data corruption (distinct from data loss, mind)
In those cases, being 10x faster is very compelling.
Note that this is about ingest for bulk loads, while online transactions not being durable is a really bad idea.
For bulk load ingest, you can usually retry the whole operation. Not so for transactions.