I worked at a company a few years back that used YoLO trained on billions of UI screenshots to navigate the UI of any desktop application based on plain English

I worked at a company a few years back that used YoLO trained on billions of UI screenshots to navigate the UI of any desktop application based on plain English instructions. It already exists.