6 ms·
You might like: https://transformer.huggingface.co https://transformer.huggingface.co The GPT-2 model is very similar to GPT-3 just smaller.
by ersiees 6y ago
You might like: https://transformer.huggingface.co https://transformer.huggingface.co
The GPT-2 model is very similar to GPT-3 just smaller.
- superasn 6y agoThanks for the link. So as someone who is completely new to this, if this guy used this model instead of gpt 3 would he get similar results?
- sanxiyn 6y agoNo, because the model is smaller.
- dhairya 6y agoout of the box probably not. gpt-3 is pretrained on a much larger corpus and is a much higher capacity model, which is why its been performing very well in zero-shot learning examples like the one above. That being said you should try it. Note the huggingface library is a python library, so you'd technically be writing some code, though the library API is super user friendly and the community is very helpful.
- calebkaiser 6y agoIf you want to play with your own GPT-2 API, I put this together and shared it on HN yesterday: https://github.com/cortexlabs/cortex/tree/master/examples/pytorch/text-generator https://github.com/cortexlabs/cortex/tree/master/examples/py... You can run that and deploy your own GPT-2 API locally, or in the cloud. I'd also recommend checking out Max Woolf's gpt-2-simple, which is a library that makes it really easy to fine tune GPT-2 with your own text (if you've played the free version of AI Dungeon, this is how they trained their model): https://github.com/minimaxir/gpt-2-simple https://github.com/minimaxir/gpt-2-simple