I absolutely will use a robots.txt on my personal sites, which will include a tarpit. This has nothing to do with keeping my webserver from crashing, and has m

I absolutely will use a robots.txt on my personal sites, which will include a tarpit. This has nothing to do with keeping my webserver from crashing, and has more to do with crawlers using content to train AI. Anything I actually want to keep as a legacy, I’ll store with permanent.org