3 ms·
It is not obvious to me why word2vec's training objective yields this. word2vec ensures similarity of related words, but why can you then perform linear algebra
by esafak 3y ago
It is not obvious to me why word2vec's training objective yields this. word2vec ensures similarity of related words, but why can you then perform linear algebra on unrelated words?
- blackbear_ 3y agoThe training objective does not have much to do with it, the bigger reason is that these neural networks themselves use linear algebra (dot products/projections and whatnot) to manipulate embeddings.