3 ms·
They already have it: http://www.linkedin.com/robots.txt http://www.linkedin.com/robots.txt
by tszming 14y ago
They already have it: http://www.linkedin.com/robots.txt http://www.linkedin.com/robots.txt
- sleepyhead 14y agoAh, ok, strange that they have /sitemap.xml in addition to that then. I would assume any robot that would understand sitemap also understands that it can be specified in robots.txt