I wish this were true too but it doesn't appear that llms.txt is meant to be a markdown version of the site's content based on the example on the site and after

I wish this were true too but it doesn't appear that llms.txt is meant to be a markdown version of the site's content based on the example on the site and after peeking at a few llms.txt files on some of the sites in the directory. It looks like its text meant to be fed into the llm as a system prompt specific to the site. The most simple ones just look like a sitemap restricted to documentation: https://www.activepieces.com/docs/llms.txt https://www.activepieces.com/docs/llms.txt Some interesting stuff is in some of them. Like this one that prompts the LLM to explain to the user the ethical issues of using AI agents along with a disclaimer: https://boehs.org/llms.txt https://boehs.org/llms.txt That site appears to be someone's blog and they don't seem like big fans of LLMs. https://boehs.org/node/llms-destroying-internet https://boehs.org/node/llms-destroying-internet A pretty clever use of llms.txt.