I’ve seen projects where the company outsourced the scraping to contractors with just vague instructions to “source the data.” That way the company is insulated

I’ve seen projects where the company outsourced the scraping to contractors with just vague instructions to “source the data.” That way the company is insulated somewhat. Not entirely. And the ethical issue is still there. It’s not an answer to your question, but this does tell you what some companies do in practice to sidestep the issue. Might work for some research projects too.