3 ms·
Text prediction is usually called "language modeling" in NLP. Because it's useful as a weak supervision signal to improve performance on other tasks, most of th
by yorwba 8y ago
Text prediction is usually called "language modeling" in NLP. Because it's useful as a weak supervision signal to improve performance on other tasks, most of the mentioned libraries support it. However, they might not always provide complete examples, instead assuming that you know how to express the model and train it using the primitives provided by the library.
Flair: https://github.com/zalandoresearch/flair/blob/master/flair/models/language_model.py https://github.com/zalandoresearch/flair/blob/master/flair/m...
Allen NLP: https://github.com/allenai/allennlp/blob/master/allennlp/data/dataset_readers/language_modeling.py https://github.com/allenai/allennlp/blob/master/allennlp/dat...
PyText: https://github.com/facebookresearch/pytext/blob/master/pytext/models/language_models/lmlstm.py https://github.com/facebookresearch/pytext/blob/master/pytex...
spaCy seems to focus on language analysis and I couldn't find an API that'd be directly usable for text generation.
- plagtag 8y agoFlair looks really promising to me!