4 ms·
postgres pgvector is a decent implementation by now which is likely available in most setups that postgres will run on. You can also use faiss if you want it a
by abraxas 2y ago
postgres pgvector is a decent implementation by now which is likely available in most setups that postgres will run on.
You can also use faiss if you want it all in memory at all times and have the RAM to support it.
What's your use case and the volume of vectors you want to look up?
- tmaly 2y agoI have a knowledge store of all my notes in markdown. I wanted a way to incorporate them with RAG.
- abraxas 2y agoHow many vectors is that? If under 100K then keep it all in memory. Hell probably in the low millions would be OK. You can literally write them to a flat file and load into memory and do a full scan for every lookup and it will be fast enough. If not then use faiss with hnsw indexing and it will be screaming fast.