2 ms·
Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. There are ~1.2 million torrents indexe
by sauere 12y ago
Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. There are ~1.2 million torrents indexed, lets just assume that a single magnet-link plus some metadata is 0,5-1kB... so that would be an total of ~1GB data.
- chimeracoder 12y ago> Why would you want that? The magnet links alone are rather useless. The whole site can be crawled within 2-3 days easily. But the entire site archive is already available as a torrent indexed on TPB - why bother crawling? That's what I'm referring to - search "pirate bay archive" on TPB and you'll find it. The magnet links are not useless, because they are able to query the rest of the metadata from a tracker and/or DHT. I'm thinking about this from the perspective of 'minimal amount of information needed in order to reproduce TPB', not 'how much information does TPB index (which is obviously much larger). (Remember that TPB no longer even operates its own tracker, so if TPB itself were taken offline, the magnet links would still work fine).