Your comment seems to suggest the answer is no, and that LLMs can indeed learn sensory-grounded information, but it's just orders of magnitude less efficient to

Your comment seems to suggest the answer is no, and that LLMs can indeed learn sensory-grounded information, but it's just orders of magnitude less efficient to train them on text rather than on multimodal data.