4 ms·
In a "good" embedding, they do.
by samus 3y ago
In a "good" embedding, they do.
- tonyarkles 3y agoWhen I was first reading about Word2vec I thought it was absolutely wonderful that the vector delta (king - queen) was similar to the vector delta (man - woman). That captures relationships in such a fascinating way!
- esafak 3y agoIt is not obvious to me why word2vec's training objective yields this. word2vec ensures similarity of related words, but why can you then perform linear algebra on unrelated words?
- blackbear_ 3y agoThe training objective does not have much to do with it, the bigger reason is that these neural networks themselves use linear algebra (dot products/projections and whatnot) to manipulate embeddings.