2 ms·
So one vector per article? Doesn’t this skew results? A short article with 0.9 relevance score would rank higher than a long article containing one paragraph wi
by leobg 5y ago
So one vector per article? Doesn’t this skew results? A short article with 0.9 relevance score would rank higher than a long article containing one paragraph with 1.0 relevance. Am I mistaken?
- visarga 5y agoIt's a known problem. Choosing appropriately between cosine similarity or dot product depending on your use case can help.
- marginalia_nu 5y agoYeah, this is also a problem traditional search ranking algorithms needs to compensate for.