3 ms·
This is like the ABC of SEO, BUT there is a robots.txt that may keep those crawlers away..
by mikemoka 15y ago
This is like the ABC of SEO, BUT there is a robots.txt that may keep those crawlers away..
- johnx123-up 15y agohttp://www.delicious.com/robots.txt http://www.delicious.com/robots.txt and http://delicious.com/robots.txt http://delicious.com/robots.txt - same copy Apart from SEO, it is also a bad practice. Think of multiple copies spread across many subdomains without any purpose