3 ms·
Something I don't understand: I thought that when using LSTM for classification, the input vector for the sentence was a single vector of length 300, recurrent
by ppod 8y ago
Something I don't understand:
I thought that when using LSTM for classification, the input vector for the sentence was a single vector of length 300, recurrently updated with each word in the text. And for the averaging method, it was a vector of length 300, the average of each of the vectors of length 300 for the words in the sentence. At what stage in the standard process would a matrix of size V*300 be used to represent a sentence or document?
- twotwotwo 8y agoI think the big matrix in the post is the "dictionary" used to map words to NN input vectors, not a representation of one input sentence or document. So its size is (total words understood by NN * dimensions of embedding).
- ppod 8y agoYes, sorry that's actually quite clear in the text now that I read it again.