I suspect that this problem can be solved with greater computer power — instead of trying to squeeze everything into the context, LLMs will be fine-tuned to the

I suspect that this problem can be solved with greater computer power — instead of trying to squeeze everything into the context, LLMs will be fine-tuned to the design and architecture of each codebase. Essentially, we’re relying only on “short term” memory for code generation at the moment, but should be using a mix of long- and short- term memory, just like human programmers. Copilot and similar use-cases is like asking a random stranger a question on Stack Overflow. They may or may not be able to provide a useful answer, and that is highly dependent on the amount and quality of the context provided. If you want an “AI coworker”, then proper “learning” will be needed…