4 ms·What? Google has respected robot.txt for ever, why do you think it will change now?by google234123 3y agoWhat? Google has respected robot.txt for ever, why do you think it will change now?ipaddr 3y agoIt doesn't always and often returns with no agent from a google ip.notatoad 3y agois there any evidence of this that you can share?