This has been a perfect description of my experience doing this. I had written some code to go through reasonably complex web onboarding flows and it basically

This has been a perfect description of my experience doing this. I had written some code to go through reasonably complex web onboarding flows and it basically played out exactly like you predicted in your comment. In addition, I've been working with some vendors that have been trying to do the same thing and they're finding that it works out just like you describe. The handwritten automations have performed better and the issues are reproducible, so even when there are issues, there's some sense of forward progress as you fix them. With handing it all over to an agent, it really feels like running around in circles. I think there's probably something here, but it's less trivial than just tossing a webpage at chatGPT and hoping for the best.