2 ms·Does Google have a track record of not respecting robots.txt? Otherwise why is it a problem?by raincole 3y agoDoes Google have a track record of not respecting robots.txt? Otherwise why is it a problem?