Sometimes output doesn't make sense because the only "sense" LLMs have is the digital word. You can only infer so much information from this. Multimodal LLMs, w

Sometimes output doesn't make sense because the only "sense" LLMs have is the digital word. You can only infer so much information from this. Multimodal LLMs, where semantics are inferred across multiple sensory modalities, have already proven to be significantly better at making sense.