3 ms·
I wonder, could something like this be used for automated testing? Eg, UI testing is always a concern of mine - i like full end to end testing, but UI is diffic
by notheguyouthink 10y ago
I wonder, could something like this be used for automated testing? Eg, UI testing is always a concern of mine - i like full end to end testing, but UI is difficult.
I wonder if we could have somewhat machine learning trained image recognition bots click a Next button, without having to specifically provide the image. Making testing much less cumbersome, and more like "click button X, require 10 list items on screen", etc. Note that this package doesn't have any ML i believe, it was just an example since this package does have bitmap comparison it looks like.
- vvvway 10y agoFind an image on screen, read pixels from an image will be Update,Maybe use Perceptual hash algorithm and consider other algorithms.
- yorwba 10y agoYou could try to integrate it with whatever a screen reader does to read the text on buttons to its user. As a bonus, all your UI tests double as accessibility tests.
- vvvway 10y agoThank you for your suggestion,I will think seriously about it or add it.
- sigmonsays 10y agosikuli is a project that can find things on screen and (among other things) click it. its a pretty interesting project. Would be nice to integrate some of its logic into robotgo
- vvvway 10y agoIts a indeed interesting project.