4 ms·
Is it being implemented? I mean, I can find http://www.ietf.org/robots.txt http://www.ietf.org/robots.txt but not http://www.ietf.org/.well-known/robots.txt htt
by fesja 14y ago
Is it being implemented? I mean, I can find http://www.ietf.org/robots.txt http://www.ietf.org/robots.txt but not http://www.ietf.org/.well-known/robots.txt http://www.ietf.org/.well-known/robots.txt
- icebraining 14y agoIt's supposed to be used by newer specifications, not change existing ones like robots.txt. That would create too many problems with existing applications.