3 ms·
> theoretically possible to linearize a random write workload Are there filesystems or databases which are specially designed to optimize for this constraint?
by mikepurvis 7y ago
> theoretically possible to linearize a random write workload
Are there filesystems or databases which are specially designed to optimize for this constraint? It would basically boil down to structuring your whole system as a set of interlinked mostly-append journals.
- barrkel 7y agoYes, they're called log-structured file systems. Been around for decades, lots of research.
- londons_explore 7y agoBigtable is exactly this. An entire database is saved in a small number of files which are are append-only (and therefore can be written fully linearly). Reads of a single record usually only read a single disk block. In-memory indexes to locate the block are fairly small, even for 1B+ records. Reads of a range of records do N range reads of blocks, where N is typically < 5, and the number of bytes read compared to the number of bytes returned to the user is typically <10% overhead.
- deleted 7y ago[deleted]
- pwg 7y agoYes, see this at least as one reference: https://en.wikipedia.org/wiki/Log_structured_filesystem https://en.wikipedia.org/wiki/Log_structured_filesystem