It's not a particularly onerous requirement and far cheaper than calling your lawyers. If you're making the argument that the company that is automatically spi

It's not a particularly onerous requirement and far cheaper than calling your lawyers. If you're making the argument that the company that is automatically spidering your content should stop then your case is somewhat undermined by failing to take the simple steps to prevent aforementioned spidering.