Interesting. They say that crawling is prohibited there, actually, and have a blanked 'Disallow' at the end. # Notice: The use of robots or other automated

Interesting. They say that crawling is prohibited there, actually, and have a blanked 'Disallow' at the end. # Notice: The use of robots or other automated means to access LinkedIn without # the express permission of LinkedIn is strictly prohibited. ... User-agent: * Disallow: / All the listed bots are only able to access a small subset of pages, the same for each bot apart from one. The 'deepcrawl' bot is privileged, and gets to see the '/profinder' pages, for some reason? # Profinder only for deepcrawl Allow: /profinder* Anyone know who operates this bot?