I’ve often thought this kind “do what I mean” control could expand to a lot of machines where currently it takes potentially years to develop an intuition aroun

I’ve often thought this kind “do what I mean” control could expand to a lot of machines where currently it takes potentially years to develop an intuition around how moving various levers/pedals actually results in things moving physically in space the way that you intend. A few years ago I rented a mini excavator whose levers are directly connected to hydraulic valves that control the motion of the bucket in a weird polar coordinate space. It’s extremely tricky as a beginner to even e.g. make the bottom of a trench level, and it seems like just a bit of intelligence would make this trivial. Even a bit of force feedback would do wonders for controllability.