3 ms·
> People treat vector search like magic pixie dust but the reality is that it's not that great unless you heavily tune your models to your use cases I believe
by motoboi 2y ago
> People treat vector search like magic pixie dust but the reality is that it's not that great unless you heavily tune your models to your use cases
I believe that what most people miss is that embeddings are the product of the model.
Embeddings have been getting so much better with the new models and so embedding-based search improved too.
Embeddings are coordinates in a world representation that "organizes" information so that location in that world matters and serve as a way to differentiate meaning.
In other worlds, word2vec was a simple and poor world representation. OpenAI embeddings are an astounding world representations coordinates.
- autokad 2y agoalso I think its about time. we don't have the time to super fine tune the document retrieval, and that magic pixie dust gets us 90-99% there. That extra 1% could take time management doesnt want to give.