3 ms·
How does archive.is trick news sites into showing content without the paywall? Is it pure user agent spoofing? I'm wondering if this could be applied here.
by ketamine__ 6y ago
How does archive.is trick news sites into showing content without the paywall? Is it pure user agent spoofing?
I'm wondering if this could be applied here.
- nikisweeting 6y agoYeup, just the reason why we expose the USER_AGENT options in ArchiveBox config ;) https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overview#private-mode https://github.com/ArchiveBox/ArchiveBox/wiki/Security-Overv... I don't want to officially endorse using the Google bot user agent, but you're welcome to try it on your own and see if it improves the experience.
- mycall 6y agoHow does ArchiveBox function compared to https://archivarix.com https://archivarix.com? I recently used Archivarix to backup a large website (93k pages), but it messed up the js/css.