emilfroberg

4 ms·

1.
by emilfroberg 3y ago
Great article Lukas! A key takeaway here is that Llama was the best LLM. I wouldn't have expected that. (Disclaimer, Lukas and I are co-founders)
2.
by emilfroberg 3y ago
Thanks for your input, I've only tried Chroma a little bit so far and had a pretty good experience. What they also have going for them is a big community on discord that can be helpful.
3.
by emilfroberg 3y ago
Yeah, maybe they will.. But for now, the best options are the purpose-built vector databases, so why not use them?
4.
by emilfroberg 3y ago
Many of them are open source and you can host them yourself. That would make it more cost effective. Also someone mentioned https://turbopuffer.com/ . That seems like a good alternative if you're looking for something e
5.
by emilfroberg 3y ago
I quickly took a look at the redisearch ANN Benchmarks and they seem to stack up against the others (more or less same level as Milvus) in the comparison when it comes to QPS and Latency.
6.
by emilfroberg 3y ago
Yeah, that's the difference we've seen according to the QPS for the ANN Benchmarks. The same story seems to be true for other datasets too. We're looking at a 0.9 recall.
7.
by emilfroberg 3y ago
The way you explain hybrid search aligns with my understanding. Pinecone has a good article about it here https://www.pinecone.io/learn/hybrid-search-intro/ . From my understanding, all vector DBs support this.
8.
by emilfroberg 3y ago
Happy to connect. The benchmark numbers are mostly from ANN Benchmarks. For my use case, the nytimes-256 dataset was most relevant so I used that for the QPS benchmark. I also took a look at the benchmarks you've made at https:/&
9.
by emilfroberg 3y ago
Someone else also pointed out that Vespa was missing. I'll have to look in to it and add it to the article!
10.
by emilfroberg 3y ago
Me too! Couldn't find a lot of information on it yet, but I might have to try it myself to get some benchmarks
11.
by emilfroberg 3y ago
Turbopuffer looks like something I would consider. And the pricing looks to be lowest on the list from what I can see
12.
by emilfroberg 3y ago
Txtai looks interesting, maybe you could help me collect some of the comparision parameters for it?
13.
by emilfroberg 3y ago
Vespa looks interesting, hadn't seen it before but will definitely take a look at it
14.
by emilfroberg 3y ago
I made this table to compare vector databases in order to help me choose the best one for a new project. I spent quite a few hours on it, so I wanted to share it here too in hopes it might help others as well. My main criteria when choosing
15.
Choosing vector database: a side-by-side comparison(benchmark.vectorview.ai)
187 points by emilfroberg 3y ago|121 comments