5 ms·The Internet Archive never follows robots.txt and they're still aroundby geor9e 3y agoThe Internet Archive never follows robots.txt and they're still around