4 ms·
If I had to guess this is the problem > This is a regularly updated mirror p2p software really struggles with mutability. We need stable chunking (I.e. rolli
by r3trohack3r 2y ago
If I had to guess this is the problem
> This is a regularly updated mirror
p2p software really struggles with mutability.
We need stable chunking (I.e. rolling hash chunking around file boundaries) and seeders to seed addressable chunks (similar to bitswap) to preserve seeders from the previous revision when a 16TB archive partially changes.
This is something my team is actively researching alongside other p2p problem statements.
If it interests you, you know rust, and you’re looking for a job, email me.
- extraduder_ire 2y agoThere's a BIP for updatable torrents, and a number of features of bittorrent v2 make it easier. Most archive torrents I see like this usually freeze the older contents so they don't change in later updated releases. Or, release new torrents with new data and keep using the old ones.
- r3trohack3r 2y agoThanks, will take a look at the BIP