3 ms·
> indexes values in each logline. We batch together sets of lines into compressed "chunks", and only add index entries per chunk. In practices, chunks have 10
by netingle 8y ago
> indexes values in each logline.
We batch together sets of lines into compressed "chunks", and only add index entries per chunk. In practices, chunks have 1000s of lines in them - so the index tends to be many orders of magnitude smaller than in other systems.