5 ms·
Such an important problem! I get the benefit over Pinecone (which wasn't built with LLMs, etc in mind) How does this compare to Chroma? Feels like it has most
by billybones 4y ago
Such an important problem!
I get the benefit over Pinecone (which wasn't built with LLMs, etc in mind)
How does this compare to Chroma? Feels like it has most of what you're talking about, and already has an open source product live.
https://www.trychroma.com/ https://www.trychroma.com/
- swalsh 4y agoPostgres has an extension as well (pgvector). I've been using it, great performance, great scaling options (though I'm not even close to testing the limits) and gives you the full flexibility of Postgres. It's easy enough to define a docker compose file, and deploy it to my environments.
- sroussey 4y agoThat’s what I’m setting up now. What do you use to creat the embedding? OpenAI? Which model?
- computerex 4y agoTry one of the free models on huggingface: https://huggingface.co/sentence-transformers/multi-qa-mpnet-base-dot-v1 https://huggingface.co/sentence-transformers/multi-qa-mpnet-... You can run it on your laptop and it's free.
- sroussey 4y agoThat will be equivalent or better than text-davinci-003?
- abyesilyurt 4y agoHow does it scale with the number of rows?
- jxodwyer1 4y agoChroma is awesome <3 - We have some overlap with them as we store the embeddings. But, we provide additional operations on top of the data, such as clustering/fine-tuning. We're also looking into open-sourcing some tools in the near future!
- gk1 4y ago> I get the benefit over Pinecone (which wasn't built with LLMs, etc in mind) What do you mean? Pinecone was specifically made to be used alongside LLMs and other embedding models. That’s how anyone uses Pinecone.