3 ms·
As I understand it, Archiveteam doesn't do anything to mitigate the issue, which is why they used to discourage users with a "censored" internet to avoid runnin
by supriyo-biswas 3y ago
As I understand it, Archiveteam doesn't do anything to mitigate the issue, which is why they used to discourage users with a "censored" internet to avoid running the warrior.
They could use some form of quorum, where the archived page is distributed to multiple users, preferably in different countries, and only accepted if the results mostly agree. (Given dynamic pages from some of the archived services, it is an interesting problem as to how you would compare if two pages are almost the same.)
- rakoo 3y agoAh, I had the same thought you had and didn't think of dynamic content. Maybe using variable length blocks split with content-defined chunking, and if 99% of the blocks are the same then assume the content is the same, and store the 2 versions ?