Training a base model just for computer use seems like an overkill as normal reasoning model like o3 for planning + a vision model like gemini-flash is good eno

Training a base model just for computer use seems like an overkill as normal reasoning model like o3 for planning + a vision model like gemini-flash is good enough[1] without being trained specifically for computer use. But if you still want to try out this path, Google has made the screenQA dataset(rico) available[2] along with bounding boxes. 1. A framework to use local/hosted models for android use/control - https://github.com/BandarLabs/clickclickclick https://github.com/BandarLabs/clickclickclick 2. https://github.com/google-research-datasets/screen_qa https://github.com/google-research-datasets/screen_qa