4 ms·
Generate llms.txt files for AI-friendly websites
- grouchy 1y agohey i gave this a test run. not sure it worked how I expected I thought it would index the entire site? is that an offering of the product?
- ilpr 1y agoThe generator doesn't crawl and index your entire website. Instead, for llms.txt, it: - analyzes your homepage to extract site information - identifies and categorizes main navigation links - creates a structured llms.txt file following the specification This aligns with the llms.txt proposal. For llms-full.txt, it fetches the content from the links on the homepage. It's a much more complete documentation of your site. You can read more about it here: https://llms-txt.io/blog/what-are-llms-txt-files https://llms-txt.io/blog/what-are-llms-txt-files Or see examples here: https://llms-txt.io/blog/companies-using-llms-txt-examples https://llms-txt.io/blog/companies-using-llms-txt-examples