3 ms·
This is cool. With a 300-dimensional word representation, there are a lot of degrees of freedom to play with to achieve sharing meaning axes with the good words
by bravura 7y ago
This is cool. With a 300-dimensional word representation, there are a lot of degrees of freedom to play with to achieve sharing meaning axes with the good words and diverging along meaning axes with the bad words.
There's an over-indexing problem: words that happen to be very close to one or two of the targets will rank highly even when they're far away from the third. Minimizing the maximum distance from any target helps mitigate but doesn't entirely solve this problem.
This is because they combine the distances using something like more like OR-gate (are any of these very good) and should be using AND (are all of these very good).