4 ms·$20 says you're ignoring someone's robots.txt.by j_baker 13y ago$20 says you're ignoring someone's robots.txt.Ellipsis753 13y agoAs far as I'm aware you're never actually required to follow it? It's just good manners.