3 ms·
Is it just me, or is vector search not particularly good? It seems like magic at first, but then you start rubbing into a bunch of issues: 1. Too much data wi
by mind-blight 2y ago
Is it just me, or is vector search not particularly good?
It seems like magic at first, but then you start rubbing into a bunch of issues:
1. Too much data within a single vector (often even just a few sentences) makes it so that most vectors are very close to each other due to many overlapping concepts.
2. Searching over moderately sized corpus of documentation (e.g. a couple thousand pages of text) starts to degrade scoring (usually sure to the above issue)
3. Every model I've tried fails pretty regularly on named entities (e.g someone's name, a product, etc) unless it's pretty well known
4. Getting granular enough to see useful variance requires generating a ton of embeddings, which start to cause performance bottlenecks really quickly
I've honestly had a lot more success with more traditional search methods.
Edit for formatting
- esafak 2y agoThis happens when your embeddings aren't good enough. You might need to fine tune them for your task. And rerank the candidates for good measure.