5 ms·
It just issues a "HTTP/1.1 302 Moved Temporarily" directed to their homepage. Requesting an invalid file such as "robots.txtsdfa32r523" has the same effect, so
by mkonecny 13y ago
It just issues a "HTTP/1.1 302 Moved Temporarily" directed to their homepage. Requesting an invalid file such as "robots.txtsdfa32r523" has the same effect, so they probably don't have a robots file at all.
- judk 13y agoHuh? No, it is a regular robots.txt file
- tonyedgecombe 13y agoIt redirects requests from the UK.
- blossoms 13y agohttp://i.imgur.com/Jmjf3y2.png http://i.imgur.com/Jmjf3y2.png