5 ms·except google does respect robots.txt so you do have a choice?by oh_no 5mo agoexcept google does respect robots.txt so you do have a choice?PunchyHamster 5mo agostill respects robots.txt