4 ms·
Can somebody explain to this beginner how to use this? Where can I load this code and start running it? How can I train it on a dataset and what do I need to pr
by f430 6y ago
Can somebody explain to this beginner how to use this? Where can I load this code and start running it? How can I train it on a dataset and what do I need to prepare?
Lots of language here I don't understand like what is he referring to when he says 1.5B or 1T weights?
What resources/videos can I watch in order to start tinkering with this?
- vertis 6y agoThe repository readme actually includes a link to a notebook[1] that helps getting started on Google colab. It's as good a place to start as any: [1]: https://colab.research.google.com/github/EleutherAI/GPTNeo/blob/master/GPTNeo_example_notebook.ipynb https://colab.research.google.com/github/EleutherAI/GPTNeo/b...
- f430 6y agothanks, I never used this before. Do I have to add a credit card? How much will it cost to run this?
- zora_goron 6y agoColab is free to use -- you can click Runtime → Run All to run the cells in the notebook free-of-charge. (You may need to be logged in to a Google Account to run it.)
- f430 6y agovery cool! side question but is there a complete guide to learn PyTorch with Colab? I tried to learn ML a few years ago but gave up because I couldn't install CUDA on my machine for some reason. The landscape seems to change dramatically. I am interested in transformers in particular completing incomplete images like what https://openai.com/blog/image-gpt/ https://openai.com/blog/image-gpt/ does, is there a project that implements that and can let me start training? I'm excited but I just get overwhelmed as to where I need to focus my attention on. My goal is to utilize something like image-gpt but for a more narrow domain (ex. only dealing with cats), how can I build my knowledge and skills towards that goal? Much thanks for your answers I'm really looking to learn these stuffs
- deleted 6y ago[deleted]