2 ms·
word2vec is a naive technique, which relies only on the colocation of words. Yes, it misses many things - word order, grammar (e.g. negations), words with many
by stared 10y ago
word2vec is a naive technique, which relies only on the colocation of words. Yes, it misses many things - word order, grammar (e.g. negations), words with many distinct meanings (lead (Pb) vs (to) lead), synonyms vs antonyms etc.
What's interesting is that it works at all. My blog post on that: http://p.migdal.pl/2017/01/06/king-man-woman-queen-why.html http://p.migdal.pl/2017/01/06/king-man-woman-queen-why.html