Neat that this is still around, I remember using this in ~2007 for an undergrad project back when web scraping was still "easy". The only site I got blocked fr

Neat that this is still around, I remember using this in ~2007 for an undergrad project back when web scraping was still "easy". The only site I got blocked from was Google, and they blacklisted my entire CS department IP range for a day, which really upset some of the higher-ups at the time.