2 ms·
A New Web Archival Crawler Tackling Storage+Fidelity Issues
- systemskid 4y agoAuthors have developed the design of a new web archival crawler, Jawa -- JavaScript Aware Web Archiving -- which reduces storage overhead of JavaScript resources, leveraging classic program analysis techniques to identify parts of the code that won't be executed, or are irrelevant in the context of a web archive. Simultaneously, Jawa also improves web page fidelity by eliminating negative effects of JavaScript's non-determinism.