6 ms·

I like reading about IPFS, but I do not really have the time to learn about it and get involved. Last I remember, Z-Library was having an issue scaling the DHS

by Nican 4y ago

I like reading about IPFS, but I do not really have the time to learn about it and get involved. Last I remember, Z-Library was having an issue scaling the DHS to handle the number of files [1]. Did those issues get resolved? How is it going now? Also, is there anything being done to ensure every file has seeders? [1] https://news.ycombinator.com/item?id=33716560 https://news.ycombinator.com/item?id=33716560

steponlego 4y ago
Works great, that's old news which is no longer current.
ComputerGuru 4y ago
ZFS (Zettabyte File System) is very much separate from Z-Library (and its alternative frontends like libgen).
- Nican 4y ago
  Thanks. My brain crossed wires between Z-Library and IPFS. I updated my post.
  - ComputerGuru 4y ago
    Completely understandable!
survirtual 4y ago
I’ve dived deep into IPFS and built several prototypes on top of it. It ended up not being performant enough for me, and that was after heavily modifying the codebase so that it was true p2p browser & server (their webrtc transport had a lot of issues and they didn’t seem too interested in it, but my needs required it as a backbone). The security was also a concern, and the scaling had issues. Pinning millions of small items got so slow it would not function. Then I ended up having concerns over hashed based addressing being easy to censor with the architecture IPFS was using (more hub & spoke than anything, given signaling and relay servers were centralized). I could go on but I ran into so many issues I ended up implementing my own solution that did everything I wanted. Wanted to squeeze even more performance, I’ve been converting that solution to Rust. This was a couple years ago so maybe things have changed since I used it. Last I checked, they seemed busy on Filecoin. The idea of IPFS is great and I want to see it succeed, but I think that they got so caught up in their jargon and modularity, the project lost track of some fundamentals.
- password4321 4y ago
  > my own solution that did everything I wanted Your ideas are intriguing to me and I wish to subscribe to your newsletter! (I really would appreciate any pointers to additional info on something that actually works...)
  - survirtual 4y ago
    If you find something, let me know. It would save me a lot of trouble. Until then, what I’m building unfortunately doesn’t seem to have a peer. So I will keep at it. If it gets to a point where I believe it can be useful to others, I will share it freely.
    - codetrotter 4y ago
      > If it gets to a point where I believe it can be useful to others, I will share it freely. It sounds very useful already. I’d love to see the code even if it’s not in a quite working state yet.
      - survirtual 4y ago
        Trust me, when I can share I will, and gladly at that. Hopefully it will be useful and many other people take up the cause. After that I’m taking a rest-of-my-life adventure around the world’s most pristine wildernesses.
      - davidwritesbugs 4y ago
        I'll second that - even if the code is currently in poor condition. IPFS sounds great but it has a bad reputation for performance/resource hogging but from your original comment that seems to be the least of its issues. I'd love to use something like that for my project.
  - klabb3 4y ago
    I’m building a connectivity lib in Golang for relay-assisted p2p over tcp. The implementation is simple, uses only a single network connection when idle, and establishes connections very quickly and reliably. Downside is it’s not decentralized and it’s also not UDP, in case that’s your thing. Oh and BYO auth. Please reach out if it fits your use case.
benneh 4y ago
IPFS is not the only option available. Swarm's been making a lot of progress. Hackernoon released a blog post comparing the two projects. https://hackernoon.com/whats-the-difference-between-ipfs-and-ethereum-swarm https://hackernoon.com/whats-the-difference-between-ipfs-and...

by Nican 4y ago

steponlego 4y ago

Works great, that's old news which is no longer current.

ComputerGuru 4y ago

ZFS (Zettabyte File System) is very much separate from Z-Library (and its alternative frontends like libgen).

Nican 4y ago
Thanks. My brain crossed wires between Z-Library and IPFS. I updated my post.
- ComputerGuru 4y ago
  Completely understandable!

survirtual 4y ago

I’ve dived deep into IPFS and built several prototypes on top of it. It ended up not being performant enough for me, and that was after heavily modifying the codebase so that it was true p2p browser & server (their webrtc transport had a lot of issues and they didn’t seem too interested in it, but my needs required it as a backbone). The security was also a concern, and the scaling had issues. Pinning millions of small items got so slow it would not function. Then I ended up having concerns over hashed based addressing being easy to censor with the architecture IPFS was using (more hub & spoke than anything, given signaling and relay servers were centralized). I could go on but I ran into so many issues I ended up implementing my own solution that did everything I wanted. Wanted to squeeze even more performance, I’ve been converting that solution to Rust. This was a couple years ago so maybe things have changed since I used it. Last I checked, they seemed busy on Filecoin. The idea of IPFS is great and I want to see it succeed, but I think that they got so caught up in their jargon and modularity, the project lost track of some fundamentals.

password4321 4y ago
> my own solution that did everything I wanted Your ideas are intriguing to me and I wish to subscribe to your newsletter! (I really would appreciate any pointers to additional info on something that actually works...)
- survirtual 4y ago
  If you find something, let me know. It would save me a lot of trouble. Until then, what I’m building unfortunately doesn’t seem to have a peer. So I will keep at it. If it gets to a point where I believe it can be useful to others, I will share it freely.
  - codetrotter 4y ago
    > If it gets to a point where I believe it can be useful to others, I will share it freely. It sounds very useful already. I’d love to see the code even if it’s not in a quite working state yet.
    - survirtual 4y ago
      Trust me, when I can share I will, and gladly at that. Hopefully it will be useful and many other people take up the cause. After that I’m taking a rest-of-my-life adventure around the world’s most pristine wildernesses.
    - davidwritesbugs 4y ago
      I'll second that - even if the code is currently in poor condition. IPFS sounds great but it has a bad reputation for performance/resource hogging but from your original comment that seems to be the least of its issues. I'd love to use something like that for my project.
- klabb3 4y ago
  I’m building a connectivity lib in Golang for relay-assisted p2p over tcp. The implementation is simple, uses only a single network connection when idle, and establishes connections very quickly and reliably. Downside is it’s not decentralized and it’s also not UDP, in case that’s your thing. Oh and BYO auth. Please reach out if it fits your use case.

benneh 4y ago

IPFS is not the only option available. Swarm's been making a lot of progress. Hackernoon released a blog post comparing the two projects. https://hackernoon.com/whats-the-difference-between-ipfs-and-ethereum-swarm https://hackernoon.com/whats-the-difference-between-ipfs-and...