I think that was the decision of the LinkedIn scraping case about a year ago. It held that you can't have a page that is accessible to the public but not to you

I think that was the decision of the LinkedIn scraping case about a year ago. It held that you can't have a page that is accessible to the public but not to your competitor's scrapers. https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn