4 ms·Didn’t archive.org at some point say they would ignore robots.txt? I wish they would.by jjohansson 7y agoDidn’t archive.org at some point say they would ignore robots.txt? I wish they would.