3 ms·
Are you referring specifically to line 141, which sets the number of embedding elements for gpt-nano to 48? That also seems to correspond to the Channel size C
by riemannzeta 3y ago
Are you referring specifically to line 141, which sets the number of embedding elements for gpt-nano to 48? That also seems to correspond to the Channel size C referenced in the explanation text?
https://github.com/karpathy/minGPT/blob/master/mingpt/model.py#L141C70-L141C70 https://github.com/karpathy/minGPT/blob/master/mingpt/model....
- tomnipotent 3y agoThat matches the name of default model selected in the right pane, "nano-gpt". I missed the "bigger picture" at first before I noticed the other models in the right pane header.