I agree with you, current models can't work totally outside their training set. An example of AI that trained with environment and feedback/outcome learning is

I agree with you, current models can't work totally outside their training set. An example of AI that trained with environment and feedback/outcome learning is AlphaZero, and it totally beat us at our own game. Even so, DeepMind seems not to care to pay the costs of further development, so we see LLMs need to make themselves useful to people to survive. It's a "pay your costs or stop executing" situation.