3 ms·
Thanks for the feedback! The rationale is that with llms.txt you essentially have to dump the whole website info in it, which becomes non-practical for large,
by nicolasakf 2mo ago
Thanks for the feedback!
The rationale is that with llms.txt you essentially have to dump the whole website info in it, which becomes non-practical for large, deeply nested corpuses.
Authenticated content is another use case. A public text file cannot represent content available only after login.
Agentize would cover both of these use cases