3 ms·
Seems like they independently invented a sort of log structured merge tree.
by hendzen 12y ago
Seems like they independently invented a sort of log structured merge tree.
- lobster_johnson 12y agoLSM-type storage is frequently used in IR; it's not a new technique. I accidentally "invented" it a few years ago before I realized it had a name. Even Lucene 1.x used a variation of this for its "segment" files (which it still does, at least up to 3.x, afaik). The reason is that you want to keep the inverted indexes sorted on disk, but you don't want to sort the entire index every time you update. So you create one mini-index per update and merge them lazily when you get too many of them.