These folks +know+ about robots.txt stuff. If not directly, then because some staffer and most any sycophant in range has already pointed to it. The folks hav

These folks +know+ about robots.txt stuff. If not directly, then because some staffer and most any sycophant in range has already pointed to it. The folks have almost certainly explicitly told the staffers involved not to enable robots.txt, too. (If they truly were fools, they've have already enabled the robots block.) The point is to trigger the response to the troll, and the hope that the CEO will be able leverage the response to better their own business position. Some trolls deliberately stick typos or errors in their posts. Some folks show their naughty bits. Some make outrageous statements. The point is not the tech. The point is not the truth. The point is the the schtick, and the profit potential. This is the basis of modern media. It's an effective form of attention-seeking spam. This doesn't mean I don't think Google should just "accidentally" drop one or two of these organizations from the search indexes. "You're not listed? Whoops. We thought you wanted out of the Google indexes. Our bad." But that'd be both juvenile, and would serve only to get the regulatory folks and legal teams involved all spooled up.