4 ms·
If you are doing LLM, of course you do. But an amazing OSS vector DB has yet to arrived. The number of vectors it could handle needs to be in the billions, at l
by didip 4y ago
If you are doing LLM, of course you do. But an amazing OSS vector DB has yet to arrived. The number of vectors it could handle needs to be in the billions, at least.
- jessehu 4y agoWhat’s wrong with Faiss? https://github.com/facebookresearch/faiss https://github.com/facebookresearch/faiss
- rahimnathwani 4y agoDoesn't a faiss index have to fit in memory?
- jkb79 4y agoFaiss implements multiple different ANN algorithms, and some like IVF can use disk based indexes.
- rahimnathwani 4y agoThanks. I just googled 'faiss ivf disk' and a couple of clicks later found this page: https://github.com/facebookresearch/faiss/wiki/Indexes-that-do-not-fit-in-RAM https://github.com/facebookresearch/faiss/wiki/Indexes-that-...