3 ms·
They don't obey *, they don't get their own entry. I'd rather just poison their data, it's a well known behavior from them. https://www.reddit.com/r/webdev/co
by kev009 4mo ago
They don't obey *, they don't get their own entry. I'd rather just poison their data, it's a well known behavior from them.
https://www.reddit.com/r/webdev/comments/1sdzd1q/metas_ai_crawler_scraped_my_site_79_million_times/ https://www.reddit.com/r/webdev/comments/1sdzd1q/metas_ai_cr...