2 ms·
Been using pgvector for a while, and to me it was kind of obvious that the source document and the embeddings are fundamentally linked so we always stored them
by choilive 2y ago
Been using pgvector for a while, and to me it was kind of obvious that the source document and the embeddings are fundamentally linked so we always stored them "together". Basically anyone doing embeddings at scale is doing something similar to what Pgai Vectorizer is doing and is certainly a nice abstraction.
- jdthedisciple 2y agoI used FAISS as it also allowed me to trivially store them together. Idk how well it scales though, it's just doing it's job on my hobby project scale For my few 100'000s embeddings I must say the performance was satisfactory.