16 ms·
That's just way too specific to be an accident, wonder what the story is..
by pvsnp 12y ago
That's just way too specific to be an accident, wonder what the story is..
- olivierkaisin 12y agoI wouldn't be surprised to hear that they did put that url into their robots.txt because it is a search result page generated by a bot and that has been visited and indexed by Google…
- hurin 12y agoI'm not up to date on how google's current search indexing algorithm works. Supposing someone has a lot of bots that post links to `extra-small-teen-pony` or some other /sr query on nordstrom.com from other sites - would google index that?
- cmdrfred 12y agoIf they threw a custom 404 that reports 200. That's how I assumed those phone number lookup sites work.