3 ms·
Protecting text content on the web by poisoning AI scraper responses
- jsheard 2y agoI appreciate the effort but this seems really bad for both SEO and performance. My phone noticeably chugs while trying to load that simple example.
- bediger4000 2y agoBad for SEO!?! Count me in. SEO is what started fouling the web for humans in the first place. > robots.txt restrictions are routinely ignored, That's true of Bytespider and a few other crawlers that aren't search engines or AI masticators. I have Apache set to give 404 to Bytespider and a few other user agents because of this.