I also have used Simple HTML Dom One thing I haven't worked on yet is waiting for stuff to load if that is a problem. Otherwise you try to limit hitting a site

I also have used Simple HTML Dom One thing I haven't worked on yet is waiting for stuff to load if that is a problem. Otherwise you try to limit hitting a site either using sleep/CRON What's also interesting is session tokens, one site I was able to hunt down the generated token bread crumb which JS produced, but it wasn't valid. Still had to visit the site, interesting.