4 ms·
I don't know what this particular author has against LLMs, but a lot of people are bothered by the very intense, robots.txt ignorming, scraping of their sites.
by elsjaako 9mo ago
I don't know what this particular author has against LLMs, but a lot of people are bothered by the very intense, robots.txt ignorming, scraping of their sites.
The website being blocked by the scrapers would be a positive outcome.