3 ms·
GPT in 200 lines of dependency-free Python
- czep 8mo agoIt is really beautiful to see distilled to the core algorithm. Despite AK’s claim that everything else is simply optimization, I am sure there’s a bit more to training a useful frontier model! Still, an excellent teaching tool and nice way to spend an afternoon walking through the code.