Yes, you'd need something that is more involved than a textbox, but this is/can be part of AI research too: computer vision is a very old topic in AI research a

Yes, you'd need something that is more involved than a textbox, but this is/can be part of AI research too: computer vision is a very old topic in AI research after all. About how the exact UI will be for multiple objects, this is something that multiple professional tools - like 3D engines or editors - already do. A common solution (aside from the multiple click you mentioned) is to use a modifier key like Alt+click to show a list of the items under the mouse. An AI system could also show alternative interpretations of what is clicked. > Again, I'm not arguing the chat interface should be the only interface. The main issue here is that current AIs are trained using chat-like interactivity at their core with everything else being a "wrapper" around the chat parts, when it should be the other way around.