3 ms·
You're rolling along thinking this is just some bad web developer somewhere until you get to the last Disallow...
by nottestuser 12y ago
You're rolling along thinking this is just some bad web developer somewhere until you get to the last Disallow...
- lfowles 12y agoWell, I'm on a list now..
- nly 12y agoYou have something against petite young ladies of a modest stature? Sizeist!
- CoreSet 12y agoI don't get it: is that disallow targeting some sort of porn spambot crawler?
- prokizzle 12y agoMaybe that was their intention, but that's not how it's done.
- jarin 12y agoThey probably made a product with that slug by accident and are doing that to try to get it removed from search engine results.
- meej 12y agoIt makes me wonder if Nordstrom ever stocked the now-defunct Pornstar clothing brand.
- philip1209 12y agoMaybe some mal-intended inbound links that they don't want to be associated with?
- cmdrfred 12y agoIs this some sort of new terrible negative seo? Associate a target url for a bunch of negative things?
- Springtime 12y agoDisallow is used to exclude certain URLs from being crawled, in this case it looks like a search query as the store's search uses this pattern: http://shop.nordstrom.com/sr/query http://shop.nordstrom.com/sr/query .
- IgorPartola 12y agoCould that be a honeypot to trap bots that don't respect robots.txt?
- prokizzle 12y agomaybe, but why would THAT be the honey pot? it could be any phrase, really.
- IgorPartola 12y agoWell, you'd want them to try to crawl it. Perhaps there was a bot crawling their site for such links and they wanted to identify specifically that one. It seems most likely that such URL's never existed, but this would be a decent way to identify a bot that's otherwise not distinguishable.
- huhtenberg 12y agoLooks more like a mop-up after a website infection incident.
- ashmud 12y agoI have had to do that before. The URLs in that case seemed to have a more random distribution than most of these.
- shouldbeworking 12y agoThis other retailer's page is about the same except for that one entry: http://www.neimanmarcus.com/robots.txt http://www.neimanmarcus.com/robots.txt