There's a fundamental reason why doing, and learning from doing, is necessary to learn (to do), and can't be replaced with book learning. Maybe stated like thi

There's a fundamental reason why doing, and learning from doing, is necessary to learn (to do), and can't be replaced with book learning. Maybe stated like this it sounds obvious, but it runs counter to people expecting LLMs to learn to do things for themselves by "book learning" (pre-training), unless regurgitating artifacts from the training set is all you need. The issue is that intelligence and action are prediction (with motor cortex output predictions driving muscles and becoming action - a useful insight/framing from Jeff Hawkins)... In order to act well, you need to learn to predict/react well, but these predictions need to be based on your OWN state per the sensory inputs you are receiving. Learning to predict what someone else would do (being book smart) doesn't help when you're the actor, where the predictions need to be based on your own internal state.