4 ms·
I have a knowledge store of all my notes in markdown. I wanted a way to incorporate them with RAG.
by tmaly 2y ago
I have a knowledge store of all my notes in markdown. I wanted a way to incorporate them with RAG.
- abraxas 2y agoHow many vectors is that? If under 100K then keep it all in memory. Hell probably in the low millions would be OK. You can literally write them to a flat file and load into memory and do a full scan for every lookup and it will be fast enough. If not then use faiss with hnsw indexing and it will be screaming fast.