3 ms·
robots.txt is meant to be read by robots, hence the markup and location. for humans just use normal web pages. like an 'about' page, for example
by bl4k 16y ago
robots.txt is meant to be read by robots, hence the markup and location.
for humans just use normal web pages. like an 'about' page, for example
- qntm 16y agoPerhaps humans.txt would suggest which kinds of humans should and should not visit this site. Under-18s, for example.
- Mithrandir 16y agoIt's about the developers, not the users.
- qntm 16y agoI know what it is about. I'm suggesting a humans.txt which actually makes a decent analogy with robots.txt.