3 ms·
The colab measures dot product values 0.428 and 0.498, describing them as "...similarity value is quite high." Is that high? Can you design a system that confid
by mech4lunch 2y ago
The colab measures dot product values 0.428 and 0.498, describing them as "...similarity value is quite high." Is that high? Can you design a system that confidently labels data with a 0.4 threshold?
- brokensegue 2y agoThe raw output value is generally irrelevant. What matters is its position in the distribution of outputs
- fzliu 2y agoWhile the raw similarity score does matter, what typically matters more is the score relative to other documents. In the case of the examples in the notebook, those values were the highest in relative terms. I can see why this may be unclear/confusing -- we will correct it. Thank you for the feedback!
- minimaxir 2y agoA 0.4 with cosine similarity is not the same as a 0.4 with sigmoid thresholding. 0.4 cosine similarity is pretty good for real-world data that isn't an near-identical duplicate.