3 ms·
It's not just "cute", that's the whole point. Somewhat surprisingly, it was found that similarity of word representations goes beyond simple syntactic regular
by sp332 11y ago
It's not just "cute", that's the whole point.
Somewhat surprisingly, it was found that similarity of word representations goes beyond simple
syntactic regularities. Using a word offset technique where simple algebraic operations are performed on the word vectors, it was shown for example that
vector(”King”) - vector(”Man”) + vector(”Woman”)
results in a vector that is closest to the vector representation of the word
Queen.
In this paper, we try to maximize accuracy of these vector operations by developing new model
architectures that preserve the linear regularities among words. We design a new comprehensive test
set for measuring both syntactic and semantic regularities, and show that many such regularities
can be learned with high accuracy.
- SilasX 11y agoAnd if the author highlighted those as "the results", I would be impressed. As it stands, they were citing more "moonshot" kind of results like the ability to get abstract concept composition right, which is really hard to judge, because you don't know what set to sample over, or whether the equations are really insightful vs "I guess that might make sense...". I'm much more confused over how the author characterized the results ("look at this Animal/Human/Ethics thing!"). Again, if there are standard metrics by which it did well, great! But why isn't he citing them rather than these more abstract, hard-to-judge victories?