4 ms·

I wonder if Internet Archive and Common Crawl have worked together? How does their scope or infrastructure compare? I know they serve different purposes, but

by ks2048 1y ago

I wonder if Internet Archive and Common Crawl have worked together? How does their scope or infrastructure compare? I know they serve different purposes, but both are essentially doing similar things.

pabs3 1y ago
I think IA ingests crawl WARCs from CC, as well as other groups like ArchiveTeam.