23 ms·

I assume that would require BitTorrent v2 (and I think more specifically something along BEP-46 - Updating Torrents Via DHT Mutable Items) or your map is gonna

I assume that would require BitTorrent v2 (and I think more specifically something along BEP-46 - Updating Torrents Via DHT Mutable Items) or your map is gonna be out-of-sync and sad after a while.

nextaccountic 3y ago
are the torrents in the wild that uses this? and are there bittorrent clients that implement this? how do they surface the mutable aspect to the user? (is it like, your torrent client will silently update files, and if you dont want to update anymore you need to pause? can you still seed if you dont want to update?)
- anacrolix 3y ago
  I use it in anacrolix/btlink. There's support in anacrolix/dht.
  - nextaccountic 3y ago
    That's very cool! Does this serve decentralized "web app" through bittorrent? Do I need your client to seed it, or can something like qbittorrent seed it? Will I seed only the last version of the page or all versions? Can someone download an earlier version or list all past versions?
- acalcutt 3y ago
  I've been testing a setup that automatically generates OpenStreetMap/OpenMapTiles formatted pmtiles and mbtiles, then makes them available by torrent. The torrents get placed in a rss feed at https://planetgen.wifidb.net/ https://planetgen.wifidb.net/ Basically what I did was set up 'qbittorent' client to watch the openstreetmap rss weekly torrent feed. when it downloads a new pbf file, it runs this script I made at https://github.com/acalcutt/PlanetilerTorrent https://github.com/acalcutt/PlanetilerTorrent , which was based of the osm torrent creation process. The script creates pmtiles and mbtiles using planetiler, then makes torrent and starts seeding them in qbittorent. In qbittorent I have options like how long I want to seed for (30 days), what do do when done seeding (Delete the files) and also speed controls so I can limit bandwidth during my working hours. I have this running on a old laptop with 2TB nvme/64GB memory. It seeems to work pretty well so far. It would be nice if my internet speeds were a little better for initial seeding, but at least the torrents share the load with other people who are downloading/
  - nextaccountic 3y ago
    That's interesting. But it doesn't use BEP-46, right? https://www.bittorrent.org/beps/bep_0046.html https://www.bittorrent.org/beps/bep_0046.html (discussion on HN at the time, https://news.ycombinator.com/item?id=12282601 https://news.ycombinator.com/item?id=12282601)
    - acalcutt 3y ago
      I don't think so because it is not updating the same torrent it is making new ones. I am transmitting the torrent over Bittorrent/DHT like they mention, not http, but without it being the same file I'm not sure that is the same.
- xenator 3y ago
  You can't modify files, because torrent file itself is just sequence of chechsums. But there is RSS extension that allpo to pipe updates of new files.
  - nextaccountic 3y ago
    But with BEP-46 you can, right? (BEP-46 apparently doesn't use RSS) I was asking like, how widely is BEP-46 adopted in practice. It's a spec from 2016! https://www.bittorrent.org/beps/bep_0046.html https://www.bittorrent.org/beps/bep_0046.html (discussion on HN at the time, https://news.ycombinator.com/item?id=12282601 https://news.ycombinator.com/item?id=12282601)

I assume that would require BitTorrent v2 (and I think more specifically something along BEP-46 - Updating Torrents Via DHT Mutable Items) or your map is gonna be out-of-sync and sad after a while.

nextaccountic 3y ago

are the torrents in the wild that uses this? and are there bittorrent clients that implement this? how do they surface the mutable aspect to the user? (is it like, your torrent client will silently update files, and if you dont want to update anymore you need to pause? can you still seed if you dont want to update?)

anacrolix 3y ago
I use it in anacrolix/btlink. There's support in anacrolix/dht.
- nextaccountic 3y ago
  That's very cool! Does this serve decentralized "web app" through bittorrent? Do I need your client to seed it, or can something like qbittorrent seed it? Will I seed only the last version of the page or all versions? Can someone download an earlier version or list all past versions?
acalcutt 3y ago
I've been testing a setup that automatically generates OpenStreetMap/OpenMapTiles formatted pmtiles and mbtiles, then makes them available by torrent. The torrents get placed in a rss feed at https://planetgen.wifidb.net/ https://planetgen.wifidb.net/ Basically what I did was set up 'qbittorent' client to watch the openstreetmap rss weekly torrent feed. when it downloads a new pbf file, it runs this script I made at https://github.com/acalcutt/PlanetilerTorrent https://github.com/acalcutt/PlanetilerTorrent , which was based of the osm torrent creation process. The script creates pmtiles and mbtiles using planetiler, then makes torrent and starts seeding them in qbittorent. In qbittorent I have options like how long I want to seed for (30 days), what do do when done seeding (Delete the files) and also speed controls so I can limit bandwidth during my working hours. I have this running on a old laptop with 2TB nvme/64GB memory. It seeems to work pretty well so far. It would be nice if my internet speeds were a little better for initial seeding, but at least the torrents share the load with other people who are downloading/
- nextaccountic 3y ago
  That's interesting. But it doesn't use BEP-46, right? https://www.bittorrent.org/beps/bep_0046.html https://www.bittorrent.org/beps/bep_0046.html (discussion on HN at the time, https://news.ycombinator.com/item?id=12282601 https://news.ycombinator.com/item?id=12282601)
  - acalcutt 3y ago
    I don't think so because it is not updating the same torrent it is making new ones. I am transmitting the torrent over Bittorrent/DHT like they mention, not http, but without it being the same file I'm not sure that is the same.
xenator 3y ago
You can't modify files, because torrent file itself is just sequence of chechsums. But there is RSS extension that allpo to pipe updates of new files.
- nextaccountic 3y ago
  But with BEP-46 you can, right? (BEP-46 apparently doesn't use RSS) I was asking like, how widely is BEP-46 adopted in practice. It's a spec from 2016! https://www.bittorrent.org/beps/bep_0046.html https://www.bittorrent.org/beps/bep_0046.html (discussion on HN at the time, https://news.ycombinator.com/item?id=12282601 https://news.ycombinator.com/item?id=12282601)