Generally, I agree, if you can get access to the underlying structure/source, then you should use that. But I've been making UI test automation tools for 20 yea

Generally, I agree, if you can get access to the underlying structure/source, then you should use that. But I've been making UI test automation tools for 20 years. There are some cases where adding annotations is not possible or not feasible at low-cost, but the feature still needs to be automated.