4 ms·
Whelp, Page 54 blew my mind right out the window. > E(hotter) - E(hot) + E(big) ≈ E(bigger) > E(Rome) - E(Italy) + E(Germany) ≈ E(Berlin) These things are li
by Strilanc 12y ago
Whelp, Page 54 blew my mind right out the window.
> E(hotter) - E(hot) + E(big) ≈ E(bigger)
> E(Rome) - E(Italy) + E(Germany) ≈ E(Berlin)
These things are linearly separable?!
- abrichr 12y agoDeep neural networks essentially transform input data into a vector space where the data is "easier" to model. So while the input vectors may not be linearly separable in the input space, the network learns how to transform the input vectors into a space where they are.
- nl 12y agoYes. Hence 'miraculous' Word2vec.