3 ms·
I think I am convinced that Lucene works well for embeddings + retrieval tasks from this preprint. I hope the paper provides direct comparison against Pinecone,
by runeblaze 3y ago
I think I am convinced that Lucene works well for embeddings + retrieval tasks from this preprint. I hope the paper provides direct comparison against Pinecone, Chroma, etc.. With enough budget you can probably do a user study too.
Finer points:
1. I remember FAISS is very accelerated for GPUs. How does Lucene compare there?
2. "we’re not convinced that enterprises will make the (single, large) leap
from an existing solution to a fully managed service" --> Fair point but not everyone uses Lucene? I feel it is weird that this "existing solution" (Lucene) is assumed to be already adopted.
- CuriouslyC 3y agoI feel like between solr and elastic the reach is pretty deep.
- zitterbewegung 3y agoQuick question how much different is what they did is in this blog post : https://medium.com/swlh/fun-with-apache-lucene-and-bert-embeddings-c2c496baa559 https://medium.com/swlh/fun-with-apache-lucene-and-bert-embe... ?