Deep image captioning is essentially what you are describing. Check out: http://cs.stanford.edu/people/karpathy/deepimagesent/ http://cs.stanford.edu/people/k

Deep image captioning is essentially what you are describing. Check out: http://cs.stanford.edu/people/karpathy/deepimagesent/ http://cs.stanford.edu/people/karpathy/deepimagesent/ http://cs.stanford.edu/people/karpathy/densecap/ http://cs.stanford.edu/people/karpathy/densecap/