> presumably if you create an llms.txt you're not looking to manipulate anyone I don't think the public sentiment around scrapers and LLMs is that friendly. I

> presumably if you create an llms.txt you're not looking to manipulate anyone I don't think the public sentiment around scrapers and LLMs is that friendly. I personally think scraping is very important and it allows for smaller players to compete (as long as you're careful about the number of requests).