Wow, the Jason Scott! While you're here, can you please answer two questions: Does the Wayback Machine retain data excluded by new robots.txt rules? (In other

Wow, the Jason Scott! While you're here, can you please answer two questions: Does the Wayback Machine retain data excluded by new robots.txt rules? (In other words: If you change your policy in the future, can the change be retroactive?) Why does archive.org keep this policy? It drastically limits what The Wayback Machine could be. I've searched quite a bit, but I haven't found a satisfying answer.[1] 1. https://archive.org/post/1019415/retroactive-robotstxt-removal-of-past-crawls-aka-oakland-archive-policy https://archive.org/post/1019415/retroactive-robotstxt-remov... contains links to previous discussion on archive.org.