4 ms·
In cosine similarity, yes.. iirc there is a recent paper arguing that this causes cosine similarity to perform poorly in high dimensional (aka ML) vector space
by throwawaymaths 2y ago
In cosine similarity, yes.. iirc there is a recent paper arguing that this causes cosine similarity to perform poorly in high dimensional (aka ML) vector spaces.
- lainga 2y ago...How recent? Bellman coined curse of dimensionality in 1957.
- zzleeper 2y agoI think he is talking about the 2024 arxiv paper by some netflix (?) researchers that say that it's best not to normalize the dot products (so instead of cosine similarity you just have a dot product). For most commercial embeddings (openai etc) this is not a problem as the embeddings are already normalized