So the new model will modify its representation of the inputs to make it seem like its output is more suitable, and will give more literally correct but useless

So the new model will modify its representation of the inputs to make it seem like its output is more suitable, and will give more literally correct but useless results? OpenAI say “look it’s smarter”, but to me this sounds like it’s hitting a wall, and that it’s unable to achieve better results in the ways people want.