3 ms·
This isn't true. Learning how to train a 124M is just as useful as a 700B, and is possible on a laptop. https://github.com/karpathy/nanoGPT https://github.com/k
by fzzzy 2y ago
This isn't true. Learning how to train a 124M is just as useful as a 700B, and is possible on a laptop. https://github.com/karpathy/nanoGPT https://github.com/karpathy/nanoGPT
- Miraste 2y agoTo clarify my point: Learning how to make a small website is useful, and so is the website. Learning how to finetune a large GPT is useful, and so is the finetuned model. Learning how to train a 124M GPT is useful, but the resulting model is useless.