jaykmody

3 ms·

1. 1.▲
   by jaykmody 9mo ago

   https://jaykmody.com
2. 2.▲
   by jaykmody 4y ago

   Author here. It's a design choice, but there's two reasons I chose to use imports like this: 1) For demonstrative purposes. The title of the post is `A GPT in 60 Lines of NumPy`, I kinda wanted to show "hey it's just num
3. 3.▲
   by jaykmody 4y ago

   Hey ya'll author here! Thank you for all the nice and constructive comments! For clarity, this is ONLY the forward pass of the model. There's no training code, batching, kv cache for efficiency, GPU support, etc ... The goal here