4 ms·
A friend pointed this out to me a few weeks ago. I found it was nearly impossible to enjoy because a single numerical distance metric provides almost no help i
by avalys 4y ago
A friend pointed this out to me a few weeks ago.
I found it was nearly impossible to enjoy because a single numerical distance metric provides almost no help in figuring out what direction to move to improve your guess, and any change in the distance metric when you're far away from the solution is really just a false signal - i.e. "mother" gives a score of 20, "grandmother" gives a score of "23", but grandmother isn't actually closer to the final word ("malfeasance") in any meaningful way than mother is.
Another issue with it is that the training set comes largely from newspaper articles, which means the semantics it learns sometimes have significant artifacts resulting from associations that are common in news coverage but not the English language in general.
As a result my own experience with it was "think of random guesses endlessly until you end up somewhat close and then be frustrated at what you learn about the embedding when you eventually converge on the answer."
- zardo 4y agoIt would be interesting if it provided a direction. 3.8 as "cat" is to "pig"
- dchapp 4y ago> the semantics it learns sometimes have significant artifacts resulting from associations that are common in news coverage I think this is largely the point. The game is significantly easier (for me at least) when I limit myself to thinking about what words would have high co-occurrence in English print journalism.
- nomel 4y ago> "mother" gives a score of 20, "grandmother" gives a score of "23", Doesn't this make sense though? A small change like that means you didn't really move, so you didn't get further or nearer the solution. Grandmother and mother are pretty similar.