4 ms·
The same could be said of robots.txt And anything else that might tell them not to access something.
by dspillett 4mo ago
The same could be said of robots.txt
And anything else that might tell them not to access something.
- reddalo 4mo agorobots.txt predates the modern web though
- dspillett 4mo agoMy point was that llms.txt not working is no different from them ignoring everything else that came before and probably everything that is yet to come. If they want it, they will take it, polite directives in text files will have no effect.