My mind jumped to this one sentence summary: Search has come to reflect the wishes of the searched, rather than the searcher. "Wishes of the searched" has sev

My mind jumped to this one sentence summary: Search has come to reflect the wishes of the searched, rather than the searcher. "Wishes of the searched" has several dimensions, and now goes far beyond any setting in robots.txt .