3 ms·
Naive junior engineers eventually learn and become competent senior engineers. LLMs forget everything they "learn" as soon as the context window gets too big.
by spzb 9mo ago
Naive junior engineers eventually learn and become competent senior engineers. LLMs forget everything they "learn" as soon as the context window gets too big.
- MontyCarloHall 9mo agoVery true! I liken AI to having an endless supply of newly hired interns with near-infinite knowledge but intern-level skills.
- cheevly 9mo agoThere are like a dozen well-established ways to overcome this. Learn how to use the basic tools and patterns my dude.