12 ms·
github has a bunch of them for years, the most known from Andrej Karpathy: https://github.com/karpathy/nanoGPT https://github.com/karpathy/nanoGPT some other
by numba888 2y ago
github has a bunch of them for years, the most known from Andrej Karpathy:
https://github.com/karpathy/nanoGPT https://github.com/karpathy/nanoGPT
some other have MoE implemented.
- benreesman 2y agonanoGPT is awesome (and I highly recommend his videos on it), but it’s closer to a direct reproduction of GPT-2, so it’s cool to have a really clean implementation of some newer ideas.
- Nimitz14 2y agonanoGPT contains some new ideas. https://github.com/karpathy/minGPT https://github.com/karpathy/minGPT is more plain
- syassami 2y agoPersonal fave: https://github.com/karpathy/llama2.c https://github.com/karpathy/llama2.c