With scraping I'd be concerned about legal issues more than I would about getting "shut down or blocked" technically. On the other time, I spent my postdoc ti

With scraping I'd be concerned about legal issues more than I would about getting "shut down or blocked" technically. On the other time, I spent my postdoc time working on "low observable" webcrawlers rather than physics... I'd seriously considered a sports-related project based on open data and I was still concerned that I could get into legal trouble, so I sorta merged the project into something much bigger, in which the sports content would be barely noticeable.