You don't. These seems to be this idea that LLMs can do it all, but the reality is that it itself has limited amounts of memory, and thus context. And this is

You don't. These seems to be this idea that LLMs can do it all, but the reality is that it itself has limited amounts of memory, and thus context. And this is not tied to the LLMs. It's that to EVERYTHING we do. There are limits everywhere. And for humans the context window might be smaller, but at least we have developed methods of abstracting different context windows, by making libraries. Now, as a trade-off of trying to go super-fast, changes need to be made in response to your current prompts, and there is no time validate behavior in cases you haven't considered. And regardless of whether you have abstractions in libraries, or whether you have inlined code everywhere, you're gonna have issues. With libraries changes in behavior are going to impact code in places you don't want, but also, you don't necessarily know, as you haven't tested all paths. With inlined code everywhere you're probably going to miss instances, or code goes on to live its own life and you lose track of it. They built a skyscraper while shifting out foundational pieces. And now a part of the skyscraper is on the foundation of your backyard shed.