3 ms·
Vector databases are used to store embeddings.
by H1Supreme 2y ago
Vector databases are used to store embeddings.
- crowcroft 2y agoBut why is that? I’m sure it’s the ‘best’ way to do things, but it also means more infrastructure which for simple apps isn’t worth the hassle. I should use redis for queues but often I’ll just use a table in a SQLite database. For small scale projects I find it works fine, I’m wondering what an equivalent simple option for embeddings would be.
- e0 2y agoPerhaps sqlite-vss? It adds vector searches to sqlite. https://github.com/asg017/sqlite-vss https://github.com/asg017/sqlite-vss
- chuckhend 2y agocheck out https://github.com/tembo-io/pg_vectorize https://github.com/tembo-io/pg_vectorize - we're taking it a little bit beyond just the storage and index. The project uses pgvector for the indices and distance operators, but also adds a simpler API, hooks into pre-trained embedding models, and helps you keep embeddings updated as data changes/grows