3 ms·
Easy! My robots.txt blocks crawlers, all of them (I’m not interested in my data getting slurped up by AI VCs or playing the SEO game, duh.) I can also plant so
by floam 2y ago
Easy! My robots.txt blocks crawlers, all of them (I’m not interested in my data getting slurped up by AI VCs or playing the SEO game, duh.)
I can also plant some links to the blog on the clearnet before it exists.