4 ms·

A .torrent file hosted by the Internet Archive, since DDOSecret is apparently being DDOSed: https://web.archive.org/web/*/https://data.ddosecrets.com/file/Sherw

A .torrent file hosted by the Internet Archive, since DDOSecret is apparently being DDOSed: https://web.archive.org/web/*/https://data.ddosecrets.com/file/Sherwood/Sherwood.torrent https://web.archive.org/web/*/https://data.ddosecrets.com/fi...

black_puppydog 7y ago
This size of dataset does seem to me like a good case of why the current torrent format is lacking. Many people might be interested in generally seeding for this torrent, and maybe pulling some of the files. But few are actually going to download the full 2TB. At the moment, I can select individual files to download and seed, ignoring the rest, but I cannot say "download what I want, and then seed random blocks up to a size of X GB." It's quite conceivable that in a few months, the bigger, less "popular" files will be very hard to come by. That's (maybe the) one thing I think IPFS gets really right: full availability of the whole dataset, regardless of the popularity of the individual blocks. There were some BEPs about that IIRC, but they never got anywhere. I always figured archive.org and similar collection hosters would be interested in this sort of thing, so that people can just "donate 1 TB to archive.org" or such.
- 22c 7y ago
  I agree with what you're saying, although there is not really a reason why this can't be done with BT client-side. It's just that, AFAIK, no torrent client supports this. BT will, by default, prefer to download the least popular blocks. Client-side just needs a setting to "stop downloading after X blocks", divide your 1TB by the block size, and that's how many blocks you need to download to get 1TB. I will add though, unfortunately with this torrent (at least the one that I am attempting to download), simply seeding a certain number of blocks is not very helpful. The files are mostly in a few giant zip files.

black_puppydog 7y ago

This size of dataset does seem to me like a good case of why the current torrent format is lacking. Many people might be interested in generally seeding for this torrent, and maybe pulling some of the files. But few are actually going to download the full 2TB. At the moment, I can select individual files to download and seed, ignoring the rest, but I cannot say "download what I want, and then seed random blocks up to a size of X GB." It's quite conceivable that in a few months, the bigger, less "popular" files will be very hard to come by. That's (maybe the) one thing I think IPFS gets really right: full availability of the whole dataset, regardless of the popularity of the individual blocks. There were some BEPs about that IIRC, but they never got anywhere. I always figured archive.org and similar collection hosters would be interested in this sort of thing, so that people can just "donate 1 TB to archive.org" or such.

22c 7y ago
I agree with what you're saying, although there is not really a reason why this can't be done with BT client-side. It's just that, AFAIK, no torrent client supports this. BT will, by default, prefer to download the least popular blocks. Client-side just needs a setting to "stop downloading after X blocks", divide your 1TB by the block size, and that's how many blocks you need to download to get 1TB. I will add though, unfortunately with this torrent (at least the one that I am attempting to download), simply seeding a certain number of blocks is not very helpful. The files are mostly in a few giant zip files.