4 ms·

So it seems like they still use vectors - they just replaced the search (however that works) with a dot product operation? I mean from a vector point of view th

So it seems like they still use vectors - they just replaced the search (however that works) with a dot product operation? I mean from a vector point of view that makes total sense

dartos 3y ago
Searching in LLM land is finding the cosine similarity of two high dimensional vectors. Vector databases try optimizing that operation. Maybe they found search by plain old dot product faster
- akomtu 3y ago
  Cosine what? Isn't it just dot product?
  - dartos 3y ago
    There are a few “distance” metrics that are used. AFAIK cosine similarity or cosine distance is a common one bc it’s faster than a dot product.