3 ms·
Binary, quantize each dimension to +1 or -1 You can try out binary vectors, in comparison to quantize every pair of vectors to one of four values, and a lot mo
by lsb 2y ago
Binary, quantize each dimension to +1 or -1
You can try out binary vectors, in comparison to quantize every pair of vectors to one of four values, and a lot more, by using a FAISS index on your data, and using Product Quantization (like PQ768x1 for binary features in this case) https://github.com/facebookresearch/faiss/wiki/The-index-factory https://github.com/facebookresearch/faiss/wiki/The-index-fac...
- barakm 2y agoAppreciate the link; but would still like to know how well it works. If you have a link for that, I’d be much obliged
- lsb 2y agoIt depends on your data and your embedding model. For example, I was able to quantize embeddings of English Wikipedia from 384-dimensions down to 48 7-bit dimensions, and the search works great: https://www.leebutterman.com/2023/06/01/offline-realtime-embedding-search.html https://www.leebutterman.com/2023/06/01/offline-realtime-emb...