65 ms·

What's the difference between, say, Karpathy's nanoGPT and your GPT implementation? Is it just a difference in speed, or are there some new theory details to l

What's the difference between, say, Karpathy's nanoGPT and your GPT implementation? Is it just a difference in speed, or are there some new theory details to learn? Thanks for sharing your work.

chillee 3y ago
Just a difference in speed. This repo is primarily showing how you can get really good inference perf with just native pytorch.