3 ms·
For pre-trained word2vec and fastText vectors, I think kuschku is talking about https://github.com/Kyubyong/wordvectors https://github.com/Kyubyong/wordvectors
by rpedela 9y ago
For pre-trained word2vec and fastText vectors, I think kuschku is talking about https://github.com/Kyubyong/wordvectors https://github.com/Kyubyong/wordvectors
- rspeer 9y agoOne thing that pre-trained word2vec and GloVe have going for them (and which is incorporated in ConceptNet Numberbatch) is that they're trained on broader corpora, Google News and the Common Crawl respectively. Of course that's what limits them to English, if you're not willing to use a knowledge graph to align things across languages. Training on just Wikipedia is not a representative model of any language, because not all text is written like an encyclopedia.
- rpedela 9y agoOf course the broader the corpora the better in general (sometimes more narrow is better), but Wikipedia is certainly better than nothing.