3 ms·Does this even matter? How many bots actually respect robots.txt?by chengmi 19y agoDoes this even matter? How many bots actually respect robots.txt?