4 ms·Latest CommonCrawl archive (Available FOC) includes 1.4B new URLs13 points by NickRandom 4y agoIceMetalPunk 4y agoMore URLs in CommonCrawl = more data for future LLMs/other transformer-based AIs. Which I'm all here for.