3 ms·
That is true, but it must still mess things up to have robots.txt redirected. It would appear that Google and other bots won't have any way of reaching the re
by NathanKP 17y ago
That is true, but it must still mess things up to have robots.txt redirected. It would appear that Google and other bots won't have any way of reaching the real robots.txt.
And what about sitemap.xml, atom.xml, and other typical files that could also be redirected?
- timf 17y agoThat is bit.ly's problem for not making an exception (assuming they want one in the first place, it's not required), not a general problem.
- jerf 17y ago"And what about sitemap.xml, atom.xml, and other typical files that could also be redirected?" Why not try it? As of this writing, both of those go to other places. I checked the other one that lept to mind, favicon.ico. Bit.ly appears to have hardcoded it (probably in apache configuration or equivalent for whatever server they use), however, try http://bit.ly/faviconico http://bit.ly/faviconico and look at the resulting URL. Looks like a few things were tried by the same guy. Now, pwning the favicon would have been cool.