"Reasoning" about faculties which the bot does not possess (visual, audial, or individual character domains) is simply not going to happen until we hook it up t

"Reasoning" about faculties which the bot does not possess (visual, audial, or individual character domains) is simply not going to happen until we hook it up to some symbolic model, or the LLM becomes advanced enough to infer a world model from text alone. Until then, we're basically asking a blind & deaf guy, who happens to be very well-read, to reason about senses he doesn't have. Though the mistake in your example does seem kind of egregious and I'd be curious to see whether GPT-4 would make similar mistakes.