2 ms·

Yeah, if your goal is "build the tightest 8,000 line implementation of training an LLM from scratch, with a focus on both conciseness and educational value" I d

by simonw 1y ago

Yeah, if your goal is "build the tightest 8,000 line implementation of training an LLM from scratch, with a focus on both conciseness and educational value" I don't think it's particularly surprising that Claude/Codex weren't much help.

fragmede 1y ago
Now to wait for Sonnet 5 and GPT-6, and ask them to build that, and see what they come up with.
- Tepix 1y ago
  Why would you expect an improvement?
  - bjord 1y ago
    because they'll be trained on karpathy's implementation