4 ms·
That's interesting. I suppose it could even be possible to test his theories. Just applied the exact same training methodology to smaller models or slightly eas
by qnleigh 2y ago
That's interesting. I suppose it could even be possible to test his theories. Just applied the exact same training methodology to smaller models or slightly easier problems and study what happens.
- attentionmech 2y agopeople already did: https://x.com/karpathy/status/1884678601704169965 https://x.com/karpathy/status/1884678601704169965