4 ms·

Crazy that they ended up using computer vision to find the buttons to press. We just used AutoHotKey and the Tab key.

• mikepurvis 8y ago
  With these fancy tools bringing their own UI toolkits to the table, it's possible that tab was broken— when you roll your own, accessibility is usually the first thing out the window.
• giobox 8y ago
  It struck me that using OpenCV to get the coordinates of a button might actually be _simpler_ (from a code writing perspective...) than many of the solutions to these sorts of problems I’ve used in the past. This is a pretty straightforward, maybe even 1:1 pixel mapped match you are looking for, returning the coordinates to click could be accomplished in very few lines of code with OpenCV. You could build a pretty sweet little automation library that just consumes screen captures of the things you want to click. Would greatly reduce the tedium often found in automation coding. This strikes me as so obvious I’m guessing such a library probably already exists...