3 ms·
I'm not obligated to design my websites with AI bots (or search engine bots) in mind. If I want to publish mountains of Markhov generated data on my own servers
by mvdtnz 2y ago
I'm not obligated to design my websites with AI bots (or search engine bots) in mind. If I want to publish mountains of Markhov generated data on my own servers that's my right. There's no rule that I need to use robots.txt, I didn't ask your shitty bot to crawl my site.