4 ms·
> I want to make queries on this matrix like (what are the rows most similar to row #2) There are libraries for efficient vector similarity search like https:/
by jstx1 4y ago
> I want to make queries on this matrix like (what are the rows most similar to row #2)
There are libraries for efficient vector similarity search like https://github.com/facebookresearch/faiss https://github.com/facebookresearch/faiss
- kacperlukawski 4y agoFor that scale FAISS might be not enough, as it keeps the data in memory and is simply hard to scale. It's worth considering to use a proper vector database in a distributed mode to spread the load, or just allow storing some data on disk: https://qdrant.tech/articles/memory-consumption/ https://qdrant.tech/articles/memory-consumption/