Yes, but blacklisting is not what I am thinking of. I mean the ability to exclude whole chunks from the crawler. Google would still crawl those sites, but the

Yes, but blacklisting is not what I am thinking of. I mean the ability to exclude whole chunks from the crawler. Google would still crawl those sites, but the blacklist would exclude them from results.