Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
MichaelStaniek
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
MichaelStaniek
7y ago
Yes, but thats also what happens in the normal formulation, no? So the second weight matrix actually are our context embeddings?
2.
▲
by
MichaelStaniek
7y ago
My intuition for that, and you can tell me if its wrong. The normal explanation for Word2Vec is 2 weight matrices, so the formula looks like this: (One_hot_input x W1) x W2, which is then softmaxed. W1 then is the matrix that contain our fo