2 ms·
I think this is referring to using a single cosine similarity metric for a given piece of text. The similarity between the strings “dog” and “cat” is qualitati
by didgeoridoo 2y ago
I think this is referring to using a single cosine similarity metric for a given piece of text.
The similarity between the strings “dog” and “cat” is qualitatively different from (and substantially more meaningful than) the similarity between the full contents of War and Peace and Anna Karenina, despite both being described by a single value.
In practice, you would never try to calculate the similarity between such long texts. You would use a chunking strategy to break them into pieces more likely to yield meaningful similarity values.