4 ms·
Manhattan is better than L2 at high dimensions..but why cos?
by SubiculumCode 3y ago
Manhattan is better than L2 at high dimensions..but why cos?
- SubiculumCode 3y agohttps://stats.stackexchange.com/questions/341535/curse-of-dimensionality-does-cosine-similarity-work-better-and-if-so-why https://stats.stackexchange.com/questions/341535/curse-of-di...
- godelski 3y agoCosine similarity is certainly not immune to the curse of dimensionality. In fact, it is explicitly prone to it. As dimensions increase, the likelihood that any two tensors are orthogonal rapidly increases. This is easy to reason out if you start from 2 dimensions, count the number of orthogonal vectors, and then move to 3D, and so on.