to ensure the compliance to the regulation Did legislation pass requiring people and their bots to obey robots.txt? If so I totally missed it. That would be

to ensure the compliance to the regulation Did legislation pass requiring people and their bots to obey robots.txt? If so I totally missed it. That would be big news if so.