I also have used Simple HTML Dom One thing I haven't worked on yet is waiting for stuff to load if that is a problem. Otherwise you try to limit hitting a site

I also have used Simple HTML Dom One thing I haven't worked on yet is waiting for stuff to load if that is a problem. Otherwise you try to limit hitting a site either using sleep/CRON