3 ms·
Can you recommend an implementation or paper for handling OOV words via character level embeddings?
by hiker512 9y ago
Can you recommend an implementation or paper for handling OOV words via character level embeddings?
- patelajay285 9y agoWe just open sourced a easy to use library called Magnitude that handles out-of-vocabulary words and uses Annoy indexing for fast most_similar queries for word2vec, GloVE, and fastText: https://github.com/plasticityai/magnitude https://github.com/plasticityai/magnitude
- wenc 9y agoJust an FYI, FastText's default implementation handles OOV words via word n-grams and character n-grams. (see switches -minn, -maxn, and -wordNgram) https://fasttext.cc/docs/en/options.html https://fasttext.cc/docs/en/options.html