I have experience with a tiny part of this problem; accessing the various websites and figuring out where to click. Presently, doing this requires a fair bit o

I have experience with a tiny part of this problem; accessing the various websites and figuring out where to click. Presently, doing this requires a fair bit of continuous work. Many websites don't want bots on them and are actively using countermeasures that would block operators in the same way they block scrapers. There is a ton of stuff a website can do to break those bots and they do it. Some even feed back "phantom" data to make the process less reliable. There are a lot of businesses out there where the business model breaks if someone else can see the whole board.