4 ms·

Searching in LLM land is finding the cosine similarity of two high dimensional vectors. Vector databases try optimizing that operation. Maybe they found search

by dartos 3y ago

Searching in LLM land is finding the cosine similarity of two high dimensional vectors. Vector databases try optimizing that operation. Maybe they found search by plain old dot product faster

akomtu 3y ago
Cosine what? Isn't it just dot product?
- dartos 3y ago
  There are a few “distance” metrics that are used. AFAIK cosine similarity or cosine distance is a common one bc it’s faster than a dot product.