3 ms·
Do you have links for these pretrained models? The only one I am aware of is OpenAI's where they fine tuned a Transformer architecture for 1 month on 8 gpus: h
by zawerf 8y ago
Do you have links for these pretrained models? The only one I am aware of is OpenAI's where they fine tuned a Transformer architecture for 1 month on 8 gpus:
https://blog.openai.com/language-unsupervised/ https://blog.openai.com/language-unsupervised/
https://github.com/openai/finetune-transformer-lm https://github.com/openai/finetune-transformer-lm
- sebastianruder 8y agoYou can find ELMo here: https://github.com/allenai/allennlp/blob/master/tutorials/how_to/elmo.md https://github.com/allenai/allennlp/blob/master/tutorials/ho... And ULMFiT here: http://nlp.fast.ai/category/classification.html http://nlp.fast.ai/category/classification.html
- cs702 8y agoFor those who don't know, Sebastian Ruder is a coauthor of the ULMFiT paper: https://arxiv.org/abs/1801.06146 https://arxiv.org/abs/1801.06146
- deleted 8y ago[deleted]