3 ms·
I think the big matrix in the post is the "dictionary" used to map words to NN input vectors, not a representation of one input sentence or document. So its siz
by twotwotwo 8y ago
I think the big matrix in the post is the "dictionary" used to map words to NN input vectors, not a representation of one input sentence or document. So its size is (total words understood by NN * dimensions of embedding).
- ppod 8y agoYes, sorry that's actually quite clear in the text now that I read it again.