It struck me that using OpenCV to get the coordinates of a button might actually be _simpler_ (from a code writing perspective...) than many of the solutions to

It struck me that using OpenCV to get the coordinates of a button might actually be _simpler_ (from a code writing perspective...) than many of the solutions to these sorts of problems I’ve used in the past. This is a pretty straightforward, maybe even 1:1 pixel mapped match you are looking for, returning the coordinates to click could be accomplished in very few lines of code with OpenCV. You could build a pretty sweet little automation library that just consumes screen captures of the things you want to click. Would greatly reduce the tedium often found in automation coding. This strikes me as so obvious I’m guessing such a library probably already exists...