3 ms·

As of a couple of years ago, the entire content of The Pirate Bay[0] was under 100MB[1]. Think about that for a moment - it's the index for one of the largest

As of a couple of years ago, the entire content of The Pirate Bay[0] was under 100MB[1]. Think about that for a moment - it's the index for one of the largest collections of publicly available content in the history of humanity, and it fits in my wallet 80 times over[2]. [0] Not the P2P content that people download - just the main site itself, containing all of the magnet links, etc. TPB's 'content' is literally just an index (it's not even a tracker). [1] I don't want to link to TPB from HN, but just search for "pirate bay archive". There's a large archive that contains all of the site data (db backups), but the magnet links are all you really need content-wise. [2] http://www.amazon.com/Compact-Credit-Style-Flash-Drive/dp/B00JX8STUS/ref=sr_1_1/177-4187023-1898737?ie=UTF8&qid=1412278376&sr=8-1&keywords=usb+credit+card http://www.amazon.com/Compact-Credit-Style-Flash-Drive/dp/B0...

sauere 12y ago
Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. There are ~1.2 million torrents indexed, lets just assume that a single magnet-link plus some metadata is 0,5-1kB... so that would be an total of ~1GB data.
- chimeracoder 12y ago
  > Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. But the entire site archive is already available as a torrent indexed on TPB - why bother crawling? That's what I'm referring to - search "pirate bay archive" on TPB and you'll find it. The magnet links are not useless, because they are able to query the rest of the metadata from a tracker and/or DHT. I'm thinking about this from the perspective of 'minimal amount of information needed in order to reproduce TPB', not 'how much information does TPB index (which is obviously much larger). (Remember that TPB no longer even operates its own tracker, so if TPB itself were taken offline, the magnet links would still work fine).
dmn001 12y ago
> the entire content of The Pirate Bay > Not the P2P content that people download I think you're confusing different definitions of 'content' here. Also, there are many more sites that have publicly available indexes of other links much greater than the pirate bay, google.com for example. Furthermore, 8GB is relatively small for a flash drive nowadays, e.g. here is an 128GB micro sd card: http://www.amazon.com/dp/B00M562LF4 http://www.amazon.com/dp/B00M562LF4
- toomuchtodo 12y ago
  Sandisk just released a 512GB SD card a week or two ago: http://www.sandisk.com/products/memory-cards/sd/extremepro-sdxc-sdhc-uhs-3/ http://www.sandisk.com/products/memory-cards/sd/extremepro-s...

sauere 12y ago

Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. There are ~1.2 million torrents indexed, lets just assume that a single magnet-link plus some metadata is 0,5-1kB... so that would be an total of ~1GB data.

chimeracoder 12y ago
> Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. But the entire site archive is already available as a torrent indexed on TPB - why bother crawling? That's what I'm referring to - search "pirate bay archive" on TPB and you'll find it. The magnet links are not useless, because they are able to query the rest of the metadata from a tracker and/or DHT. I'm thinking about this from the perspective of 'minimal amount of information needed in order to reproduce TPB', not 'how much information does TPB index (which is obviously much larger). (Remember that TPB no longer even operates its own tracker, so if TPB itself were taken offline, the magnet links would still work fine).

dmn001 12y ago

> the entire content of The Pirate Bay > Not the P2P content that people download I think you're confusing different definitions of 'content' here. Also, there are many more sites that have publicly available indexes of other links much greater than the pirate bay, google.com for example. Furthermore, 8GB is relatively small for a flash drive nowadays, e.g. here is an 128GB micro sd card: http://www.amazon.com/dp/B00M562LF4 http://www.amazon.com/dp/B00M562LF4

toomuchtodo 12y ago
Sandisk just released a 512GB SD card a week or two ago: http://www.sandisk.com/products/memory-cards/sd/extremepro-sdxc-sdhc-uhs-3/ http://www.sandisk.com/products/memory-cards/sd/extremepro-s...