3 ms·Because punishment for breaking the robots.txt rules is a social good.by phyzome 7mo agoBecause punishment for breaking the robots.txt rules is a social good.