I'm hoping/expecting a big improvement in long-context understanding. Currently GPT-4 has a "128K Context Window" but it does a very poor job at actually using

I'm hoping/expecting a big improvement in long-context understanding. Currently GPT-4 has a "128K Context Window" but it does a very poor job at actually using all the information in that window. Imagine you could load up that context window with information and it could use every bit of it with the same intelligence as if you only passed it a paragraph. For example, function calling is good to maybe ten different functions before it starts forgetting them or mixing then up today. Maybe in GPT-5 we can pass in 1,000s of functions and it would be able to find the relevant one every time. Or maybe we can pass in a huge codebase with line numbers, and it can identify exactly which lines need to be changed or added to implement a feature.