4 ms·
The title is a little too click-baity for my taste ("has arrived," huh?), but I think the OP is unto something. It is now possible to grab a pretrained model a
by cs702 8y ago
The title is a little too click-baity for my taste ("has arrived," huh?), but I think the OP is unto something.
It is now possible to grab a pretrained model and start producing state-of-the-art NLP results in a wide range of tasks with relatively little effort.
This will likely enable much more tinkering with NLP, all around the world... which will lead to new SOTA results in a range of tasks.
- zawerf 8y agoDo you have links for these pretrained models? The only one I am aware of is OpenAI's where they fine tuned a Transformer architecture for 1 month on 8 gpus: https://blog.openai.com/language-unsupervised/ https://blog.openai.com/language-unsupervised/ https://github.com/openai/finetune-transformer-lm https://github.com/openai/finetune-transformer-lm
- sebastianruder 8y agoYou can find ELMo here: https://github.com/allenai/allennlp/blob/master/tutorials/how_to/elmo.md https://github.com/allenai/allennlp/blob/master/tutorials/ho... And ULMFiT here: http://nlp.fast.ai/category/classification.html http://nlp.fast.ai/category/classification.html
- cs702 8y agoFor those who don't know, Sebastian Ruder is a coauthor of the ULMFiT paper: https://arxiv.org/abs/1801.06146 https://arxiv.org/abs/1801.06146
- deleted 8y ago[deleted]
- canada_dry 8y ago5 yrs ago (mostly for fun) I tried out the 'state-of-the-art' - at the time - NLTK sentiment analyzer to correlate stock market changes with a variety of news/info sources. I put it on the shelf because the sentiment analysis just wasn't up to snuf (i.e. the bias differentiation was too weak). Might be time to try again!
- bravura 8y agoCorrect me if I'm wrong, but I don't think NLTK has ever had state of the art anything.
- romaniv 8y ago>It is now possible to grab a pretrained model and start producing state-of-the-art NLP results in a wide range of tasks with relatively little effort. Are there any applications/websites where this can be seen in action? It's increasingly hard to judge how good state-of-the-art really is from research papers.
- dang 8y agoOk, we've replaced "has arrived" with a sub-heading above.