3 ms·
A lot of the internet is duplicate data, low quality content, SEO spam etc. I wouldn't be surprised if 1 TB is a significant portion of the high-quality, inform
by kgeist 8mo ago
A lot of the internet is duplicate data, low quality content, SEO spam etc. I wouldn't be surprised if 1 TB is a significant portion of the high-quality, information-dense part of the internet.
- FeepingCreature 8mo agoI would be extremely surprised if it was that small.
- kaibee 8mo agoWell, a terabyte of text is... quite a lot of text.
- artisin 8mo agoI was curious about the scale of 1TiB of text. According to WolframAlpha, it's roughly 1.1 trillion characters, which breaks down to 180.2 billion words, 360.5 million pages, or 16.2 billion lines. In terms of professional typing speed, that's about 3800 years of continuous work. So post-deduplication, I think it's a fair assessment that a significant portion of high-quality text could fit within 1TiB. Tho 'high-quality' is a pretty squishy and subjective term.
- FeepingCreature 8mo agoYes, a million books is a reasonably big library. But I would be surprised if the internet only filled a reasonably big library.