11 ms·
The simultaneous training of word representations and a classifier seems like it ignores the typically much larger unsupervised portion of the corpus. Is there
by merrellb 10y ago
The simultaneous training of word representations and a classifier seems like it ignores the typically much larger unsupervised portion of the corpus. Is there a way to train the word representations on the full-corpus and then apply this to the smaller classification training?
- eefic 10y agoYou probably meant to initialize the input->hidden weight matrix with the result of unsupervised training on the full corpus. A little tweak on how these weights are initilized would do: https://github.com/facebookresearch/fastText/blob/master/src/fasttext.cc#L358 https://github.com/facebookresearch/fastText/blob/master/src... I was a bit curious why they did not offer this by default. It seems quite useful.