"“LLMs are good at single functions, but they can’t understand a system.” This is simply a matter of increasing the context limit, is it not? And was there not

"“LLMs are good at single functions, but they can’t understand a system.” This is simply a matter of increasing the context limit, is it not? And was there not a leaked OpenAI document showing a future offering of 64k tokens?" It's a matter of exponentially increasing complexity, and does the model necessary to create more complex systems have training dataset requirements that exceed our current technology level/data availability? At some point the information-manipulation ends and the real world begins. Testing is required even for the simple functions it produces today, because theoretically the AI only has the same information as is present in publicly available data, which is naturally incomplete and often incorrect. To test/iterate something properly will require experts who understand the generated system intimately with "data" (their expertise) present in quantities too small to be trained on. It won't be enough to just turn the GPT loose and accept whatever it spits out at face value, although I expect many an arrogant, predatory VC-backed startup to try and hurt enough people that man-in-the-loop regulation eventually comes down. As it stands GPT-whatever is effectively advanced search with language generation. It's turning out to be extremely useful, but it's limited by the sum-total of what's available on the internet in sufficient quantities to train the model. We've basically created a more efficient way to discover what we collectively already know how to do, just like Google back in the day. That's awesome, but it only goes so far. It's similar to how the publicly traded stock market is the best equity pricing tool we have because it combines all the knowledge contained in every buy/sell decision. It's still quite often wrong, on both short and long-term horizons. Otherwise it would only ever go up and to the right. A lot of the sentiment I'm seeing reminds me of the "soon we'll be living on the moon!" sentiment of the post-Apollo era. Turns out it was a little more complicated than people anticipated.