Exactly. There are existing mechanisms[1] to tell Google that it’s not allowed to scrape/index your site. 1. https://developers.google.com/search/docs/crawling

Exactly. There are existing mechanisms[1] to tell Google that it’s not allowed to scrape/index your site. 1. https://developers.google.com/search/docs/crawling-indexing/block-indexing https://developers.google.com/search/docs/crawling-indexing/...