3 ms·
Using fasttext as a first pass is probably the best idea for production work.
by tensor 3y ago
Using fasttext as a first pass is probably the best idea for production work.
- minimaxir 3y agofasttext/word2vec/training-your-own-word-embeddings-from-scratch requires very optimistic assumptions about your data that rarely hold well in practice, such as not having idiosyncratic syntax from user input. I've learnt this the hard way. Transformers-based LLMs with a BPE tokenizer compensate for this well.