3 ms·
How are people using vector DBs in production? Do you typically use and manage Faiss indexes alone or use something like Milvus, Pinecone, Weaviate, or Chroma?
by tim_sw 4y ago
How are people using vector DBs in production? Do you typically use and manage Faiss indexes alone or use something like Milvus, Pinecone, Weaviate, or Chroma?
- gk1 4y agoWe put together some stories here: https://www.pinecone.io/learn/wild/ https://www.pinecone.io/learn/wild/ Usually folks use a vector database alongside a doc store like Postgres, Snowflake, Elastic…
- jeadie 4y agoA big difficulty in using vector DBs in production for things like embeddings or LLMs it that there is alot that goes into converting and processing raw input into a vector form (think chunking, formatting, encoding, inference, metadata, etc). DBs like pinecone just don't handle any of that and therefore you have to build out large systems to do it yourself. There are some platforms and open source tools that handle it end to end. https://github.com/marqo-ai/marqo https://github.com/marqo-ai/marqo is one, for example that is both open source and has a cloud offering.
- ing33k 4y agoWe are using dense_vector field that Elastic Search offers and it's scaling quite well.
- arecurrence 4y agoI’ve increasingly been using pgvector. It’s an excellent workflow when you can just include similarity search as another where clause in your sql query.
- heipei 4y agoWe're using Elasticsearch with binary vectors and our own sub-token filtering approach, but if we were to start over again today we'd simply use the dense vectors and ANN built into Elasticsearch, just with float vectors.