3 ms·Internet Archive do not respect robots.txt now. Or not consistently.by pseudalopex 5mo agoInternet Archive do not respect robots.txt now. Or not consistently.