3 ms·

Everyone needs to put the following in their robots.txt to give Linkedin a taste of their own medicine. User-agent: LinkedinBot Disallow: / # Notice: If you

Everyone needs to put the following in their robots.txt to give Linkedin a taste of their own medicine. User-agent: LinkedinBot Disallow: / # Notice: If you would like to crawl us, # please email whitelist-crawl@domain.com to apply # for white listing. *taken from linkedin.com/robots.txt

smt88 4y ago
HN messes up whitespace, so you'll have to indent this to make if preserve the newlines.
eyegor 4y ago
Ah yes, surely they will always respect the holy robots.txt