5 ms·
When I was first reading about Word2vec I thought it was absolutely wonderful that the vector delta (king - queen) was similar to the vector delta (man - woman)
by tonyarkles 3y ago
When I was first reading about Word2vec I thought it was absolutely wonderful that the vector delta (king - queen) was similar to the vector delta (man - woman). That captures relationships in such a fascinating way!
- esafak 3y agoIt is not obvious to me why word2vec's training objective yields this. word2vec ensures similarity of related words, but why can you then perform linear algebra on unrelated words?
- blackbear_ 3y agoThe training objective does not have much to do with it, the bigger reason is that these neural networks themselves use linear algebra (dot products/projections and whatnot) to manipulate embeddings.