The modality of the data contains an amount of information comparable to the data itself. Telling ChatGPT that it's hearing music rather than a story would prob

The modality of the data contains an amount of information comparable to the data itself. Telling ChatGPT that it's hearing music rather than a story would probably help it reason about it a lot. On a lower level, you can't tell ChatGPT to reason about an image when its only input is a microphone.