3 ms·I presume robots.txt is still ignored in this case?by lazyjones 5y agoI presume robots.txt is still ignored in this case?