Very interesting to see this! From the comments it seems that a bunch of people were burned by Selenium-style testing in the past. There's a pretty interesting

Very interesting to see this! From the comments it seems that a bunch of people were burned by Selenium-style testing in the past. There's a pretty interesting paper/thesis [0] about this which talks abut what kind of breakages are most common in these scenarios. Which is why (shameless plug alert) we at Rainforest [1] are working with crowdsourced testers - humans are still much, much better at visual diffing and judgement than machines are. Feel free to shoot me an email if you're interested in talking about it and figuring out how much to automate and how much to leave to humans. [0] Why do Record/Replay Tests of Web Applications Break?, Mouna Hammoudi, Gregg Rothermel, Paolo Tonella [1] https://www.rainforestqa.com/ https://www.rainforestqa.com/