3 ms·
Nah. https://twitter.com/robots.txt https://twitter.com/robots.txt They blocked robots on their marketing pages.
by mattbasta 11y ago
Nah.
https://twitter.com/robots.txt https://twitter.com/robots.txt
They blocked robots on their marketing pages.
- searchmartin 11y agoagain, no, they blocked it on WWW. only: http://webmarketingschool.com/no-twitter-did-not-just-de-index/ http://webmarketingschool.com/no-twitter-did-not-just-de-ind...