7 ms·

This is why we need a p2p git storage. I wonder if IPFS can handle this.

bArray 6y ago
P2P git is an interesting idea indeed. There is GitTorrent [1], but it appears to be mostly abandoned at the moment (for the last 5 years). The idea is quite nice but I wish it wasn't based in NodeJS. I also don't like that it integrates BitCoin - personally I think it just motivates people to try and take over the project. EDIT: There's also GitChain [2] which again seems abandoned (since 6 years). [1] https://github.com/cjb/GitTorrent https://github.com/cjb/GitTorrent [2] https://github.com/gitchain/gitchain https://github.com/gitchain/gitchain
searchableguy 6y ago
https://radicle.xyz/ https://radicle.xyz/
- Fiahil 6y ago
  Thanks ! Nice to see Rust projects being on the spearhead of innovation !
Legogris 6y ago
There are a couple of initiatives to this. Here's one (git over secure scuttlebutt): https://git.scuttlebot.io/%25n92DiQh7ietE%2BR%2BX%2FI403LQoyf2DtR3WQfCkDKlheQU%3D.sha256 https://git.scuttlebot.io/%25n92DiQh7ietE%2BR%2BX%2FI403LQoy...
- dvasdekis 6y ago
  Seems to be the most evolved of alternatives suggested. Thanks!!
- black_puppydog 6y ago
  I love git-ssb! There's one caveat: if you want to version things bigger than 5MB, you'll need to change the maximum blob size of your ssb client. Also, please be gentle with the instance linked above. If you're running patchwork and have git-ssb installed, it should be available on http://localhost:7718 http://localhost:7718 instead, that's really the way to go.
  - Legogris 6y ago
    Around 5MB seems a reasonable maximum size for git objects either way - I think that for larger objects, it should be coupled with some alternative remote for large objects. I haven't tried either, but git-annex seems to support IPFS[0] and there's also at least one implementation of IPFS for git-lfs[1]. 0: https://git-annex.branchable.com/special_remotes/ipfs/ https://git-annex.branchable.com/special_remotes/ipfs/ 1: https://github.com/sameer/git-lfs-ipfs https://github.com/sameer/git-lfs-ipfs
bkanber 6y ago
I am pretty sure IPFS handles git, or at least understands it in some form or another, as I can browse git repos in my IPFS browser.
riffic 6y ago
All the developers need to do is spin up a Gitea server hosted outside the DMCA jurisdiction. Git in itself is decentralized.
traverseda 6y ago
Have you ever tried actually using IPFS for anything? It really doesn't live up to their marketing materials. The goals are sound and the marketing materials are great, but the implementation can barely hobble along.
- karatestomp 6y ago
  Also, weird judgement. Going all NIH on URIs, and yes I've read the threads about their "reasons" and they're nonsense, it was entirely a distraction from the project's core functionality. Infrastructure-tier service with a canonical implementation in a language that's no good for writing libraries and too inefficient to be always-on in embedded and probably even a bit iffy on mobile (mind, I like Go). Anyway, I'm not sure how any kind of p2p system like that's gonna work for the average person and become mainstream when most consumer devices run on battery and drop off the network constantly to save power. Yes there are gateways but that kinda defeats the purpose. Seems better suited as a datacenter tool than something to ship out to normal end users. At any rate it's not designed for anonymity, so its utility as a piracy tool is limited unless you're on a private IPFS network, which requires server resources.
Doxin 6y ago
Git already is p2p. The whole centralized-git-through-github-or-whatnot is a fairly recent invention. Originally you'd pull directly from other developers repositories. The role of PR was fulfilled by emailing patchsets around. All github does is provide convenience. If you want to use github in a peer-to-peer fashion all the tools are already there.
- YetAnotherNick 6y ago
  Stop inventing stories. How do I pull from developer's repo? Don't say every author will need to host some server with ssh. Imagine the rate at which unmaintained repos will become unavailable.
  - vertex-four 6y ago
    You've got this the wrong way round. Someone hosts a mailing list and some "canonical" repo - e.g. Linus's Linux tree - authors post patches to the mailing list. If you want to see every patch ever submitted you subscribe to the mailing list, and your mail server holds a copy of them all. You can download archives of the mailing lists via public-inbox and suchlike. And when you want to work on it, you grab Linus's tree. The vast majority of Linux developers don't have their own publicly-accessible repository that you can pull from - they push patches to the mailing list. Various archives can host copies of the mailing lists (you can ask https://www.mail-archive.com https://www.mail-archive.com to do so for you), and the git repository can obviously be mirrored anywhere anyone who can clone it likes. Congratulations, you now have a globally mirrored, decentralised development process where the canonical repo and any patches submitted never disappear.
  - wyattpeak 6y ago
    I can't tell if you're being sarcastic or not. Yes, maintainers had to host servers. Yes, unmaintained repos disappeared.
    - Sir_Substance 6y ago
      That also depended on the project. With the right ports forwarded on your home router, servers can pop up and down as required. Mercurial had a single command for this, "hg serve", that would just pop up a webserver for sharing. It was extremely useful for me during university, and I've often considered it a key failing that git does not provide a similar command out of the box. As a result, the distributed nature of git is hidden from a lot of people. For the record, the command to make git do what mercurial does with hg serve is "git daemon --reuseaddr --base-path=. --export-all --verbose --enable=receive-pack". Obviously this is insecure and anyone who can establish a connection can push and pull from your repo, but if you're just jamming with some friends you don't need github.
Cthulhu_ 6y ago
Git already is p2p / decentralized, but I suspect you mean that you don't store all the files on your own system. But that's where bittorrent comes in, they've solved that issue already. A p2p bittorrent / magnet file index would work though, through Git (for an offline copy) or otherwise. I'm sure something like that already exists though, I've not been in the piracy world for a while now.
YetAnotherNick 6y ago
If you know who the author is, and assuming the author is not ready to revoke citizenship how is this going to solve it? DMCA (or whatever law your country has) is also applicable to IPFS. One solution is hiding names from everything like say Pirate Bay/Silk Road but I would not trust anything like that to run in my machine. I wouldn't even download TPB app if it is going to be released. It would also make discovery very hard.
- DethNinja 6y ago
  It would at least put some barriers to DMCA requests as they would have to sift through ISP logs which would take quite a bit time especially if you use a vpn. I mean realistically speaking, only solution to DMCA is through lobbying but that is almost impossible for individuals to do. This is something that needs to be done through large tech companies but it seems they think laws like DMCA increases the regulatory burden on their competitors and hence don’t care.

P2P git is an interesting idea indeed. There is GitTorrent [1], but it appears to be mostly abandoned at the moment (for the last 5 years). The idea is quite nice but I wish it wasn't based in NodeJS. I also don't like that it integrates BitCoin - personally I think it just motivates people to try and take over the project. EDIT: There's also GitChain [2] which again seems abandoned (since 6 years). [1] https://github.com/cjb/GitTorrent https://github.com/cjb/GitTorrent [2] https://github.com/gitchain/gitchain https://github.com/gitchain/gitchain

searchableguy 6y ago

https://radicle.xyz/ https://radicle.xyz/

Fiahil 6y ago
Thanks ! Nice to see Rust projects being on the spearhead of innovation !

Legogris 6y ago

There are a couple of initiatives to this. Here's one (git over secure scuttlebutt): https://git.scuttlebot.io/%25n92DiQh7ietE%2BR%2BX%2FI403LQoyf2DtR3WQfCkDKlheQU%3D.sha256 https://git.scuttlebot.io/%25n92DiQh7ietE%2BR%2BX%2FI403LQoy...

dvasdekis 6y ago
Seems to be the most evolved of alternatives suggested. Thanks!!
black_puppydog 6y ago
I love git-ssb! There's one caveat: if you want to version things bigger than 5MB, you'll need to change the maximum blob size of your ssb client. Also, please be gentle with the instance linked above. If you're running patchwork and have git-ssb installed, it should be available on http://localhost:7718 http://localhost:7718 instead, that's really the way to go.
- Legogris 6y ago
  Around 5MB seems a reasonable maximum size for git objects either way - I think that for larger objects, it should be coupled with some alternative remote for large objects. I haven't tried either, but git-annex seems to support IPFS[0] and there's also at least one implementation of IPFS for git-lfs[1]. 0: https://git-annex.branchable.com/special_remotes/ipfs/ https://git-annex.branchable.com/special_remotes/ipfs/ 1: https://github.com/sameer/git-lfs-ipfs https://github.com/sameer/git-lfs-ipfs

bkanber 6y ago

I am pretty sure IPFS handles git, or at least understands it in some form or another, as I can browse git repos in my IPFS browser.

riffic 6y ago

All the developers need to do is spin up a Gitea server hosted outside the DMCA jurisdiction. Git in itself is decentralized.

traverseda 6y ago

Have you ever tried actually using IPFS for anything? It really doesn't live up to their marketing materials. The goals are sound and the marketing materials are great, but the implementation can barely hobble along.

karatestomp 6y ago
Also, weird judgement. Going all NIH on URIs, and yes I've read the threads about their "reasons" and they're nonsense, it was entirely a distraction from the project's core functionality. Infrastructure-tier service with a canonical implementation in a language that's no good for writing libraries and too inefficient to be always-on in embedded and probably even a bit iffy on mobile (mind, I like Go). Anyway, I'm not sure how any kind of p2p system like that's gonna work for the average person and become mainstream when most consumer devices run on battery and drop off the network constantly to save power. Yes there are gateways but that kinda defeats the purpose. Seems better suited as a datacenter tool than something to ship out to normal end users. At any rate it's not designed for anonymity, so its utility as a piracy tool is limited unless you're on a private IPFS network, which requires server resources.

Doxin 6y ago

Git already is p2p. The whole centralized-git-through-github-or-whatnot is a fairly recent invention. Originally you'd pull directly from other developers repositories. The role of PR was fulfilled by emailing patchsets around. All github does is provide convenience. If you want to use github in a peer-to-peer fashion all the tools are already there.

YetAnotherNick 6y ago
Stop inventing stories. How do I pull from developer's repo? Don't say every author will need to host some server with ssh. Imagine the rate at which unmaintained repos will become unavailable.
- vertex-four 6y ago
  You've got this the wrong way round. Someone hosts a mailing list and some "canonical" repo - e.g. Linus's Linux tree - authors post patches to the mailing list. If you want to see every patch ever submitted you subscribe to the mailing list, and your mail server holds a copy of them all. You can download archives of the mailing lists via public-inbox and suchlike. And when you want to work on it, you grab Linus's tree. The vast majority of Linux developers don't have their own publicly-accessible repository that you can pull from - they push patches to the mailing list. Various archives can host copies of the mailing lists (you can ask https://www.mail-archive.com https://www.mail-archive.com to do so for you), and the git repository can obviously be mirrored anywhere anyone who can clone it likes. Congratulations, you now have a globally mirrored, decentralised development process where the canonical repo and any patches submitted never disappear.
- wyattpeak 6y ago
  I can't tell if you're being sarcastic or not. Yes, maintainers had to host servers. Yes, unmaintained repos disappeared.
  - Sir_Substance 6y ago
    That also depended on the project. With the right ports forwarded on your home router, servers can pop up and down as required. Mercurial had a single command for this, "hg serve", that would just pop up a webserver for sharing. It was extremely useful for me during university, and I've often considered it a key failing that git does not provide a similar command out of the box. As a result, the distributed nature of git is hidden from a lot of people. For the record, the command to make git do what mercurial does with hg serve is "git daemon --reuseaddr --base-path=. --export-all --verbose --enable=receive-pack". Obviously this is insecure and anyone who can establish a connection can push and pull from your repo, but if you're just jamming with some friends you don't need github.

Cthulhu_ 6y ago

Git already is p2p / decentralized, but I suspect you mean that you don't store all the files on your own system. But that's where bittorrent comes in, they've solved that issue already. A p2p bittorrent / magnet file index would work though, through Git (for an offline copy) or otherwise. I'm sure something like that already exists though, I've not been in the piracy world for a while now.

YetAnotherNick 6y ago

If you know who the author is, and assuming the author is not ready to revoke citizenship how is this going to solve it? DMCA (or whatever law your country has) is also applicable to IPFS. One solution is hiding names from everything like say Pirate Bay/Silk Road but I would not trust anything like that to run in my machine. I wouldn't even download TPB app if it is going to be released. It would also make discovery very hard.

DethNinja 6y ago
It would at least put some barriers to DMCA requests as they would have to sift through ISP logs which would take quite a bit time especially if you use a vpn. I mean realistically speaking, only solution to DMCA is through lobbying but that is almost impossible for individuals to do. This is something that needs to be done through large tech companies but it seems they think laws like DMCA increases the regulatory burden on their competitors and hence don’t care.