Agreed for the most part. If we were to be extra generous, then the audio and visuals in minecraft could be a toy case of training an agent with a multimodal s

Agreed for the most part. If we were to be extra generous, then the audio and visuals in minecraft could be a toy case of training an agent with a multimodal sensorium (can the agent avoid enemies sneaking up on them using sound cues, find mobs based on sounds, know lava is nearby by the bubbling etc.). In this case though the agent is given just RGB pixels and some structured data about their inventory, a small number of nearby voxels, their health etc. You'd have to be very generous to call structured data like that and some RGB pixels a multi-modal embodied agent though.