We have supervised learning methods to be able to map images to words, and attention networks to learn the relationship between words to formulate coherent sent

We have supervised learning methods to be able to map images to words, and attention networks to learn the relationship between words to formulate coherent sentences. I would like to see an agent that utilises both to be able to communicate with other agents to navigate in a small simulation with a given objective.