I would really advise against disallowing the archive.org bot. Their mission is a really important one in the long run that would be disrupted by everyone adopt

I would really advise against disallowing the archive.org bot. Their mission is a really important one in the long run that would be disrupted by everyone adopting a whitelist approach and cutting them out, and I'm sure that their load is negligible.