Well, yes ... obviously ;) That said, there are electrophysiological markers of semantic incongruency (e.g. table + fork = congruent, cat + rag = incongruent)

Well, yes ... obviously ;) That said, there are electrophysiological markers of semantic incongruency (e.g. table + fork = congruent, cat + rag = incongruent) that work in the auditory modality. If you're interested, the component in question is called the N400 and you should be able to find plenty of references on google shcolar.