4 ms·
Index Compression algorithms used by Google
- samratjp 17y agoObligatory: http://nlp.stanford.edu/IR-book/information-retrieval-book.html http://nlp.stanford.edu/IR-book/information-retrieval-book.h... Edit: link to compression intro page (very readable) http://nlp.stanford.edu/IR-book/html/htmledition/index-compression-1.html http://nlp.stanford.edu/IR-book/html/htmledition/index-compr...
- nirav 17y agoThank you!
- nkurz 17y agoPForDelta is another interesting approach that isn't mentioned here. It claims slightly better compression than VByte, and significantly faster (~2x) decompression on modern superscalar processors: http://www2008.org/papers/pdf/p387-zhangA.pdf http://www2008.org/papers/pdf/p387-zhangA.pdf I've yet to try it in practice.
- deleted 17y ago[deleted]
- deleted 17y ago[deleted]