4 ms·
I was curious how this works and then I saw the sqlite requests in the network tab. It's amazing to see what we have access to these days -- SQLite over HTTP ov
by mmastrac 3y ago
I was curious how this works and then I saw the sqlite requests in the network tab. It's amazing to see what we have access to these days -- SQLite over HTTP over IPFS to provide a giant, censorship-resistant database!
- TekMol 3y agoIt's censorship resistant if enough nodes mirror the sqlite file I guess. Is there any incentive for nodes to do so? Is it possible to see a statistic about how many nodes mirror it?
- lyu07282 3y agotorrents work fine without having a monetary incentive, this misconception of the blockchain crowd really has to die its killing real decentral solutions
- bakugo 3y agoPublic torrents die all the time.
- TekMol 3y agoI said "incentive". You made it "monetary incentive". What do you mean with "torrents work fine"? Do you have any statistics on the lifetime of torrents? Everything ever written to the Bitcoin blockchain is still available and massively distributed. It seems very unlikely anything will ever get lost during our lifetime. So I would say that is an example that monetary incentives do work?
- Barrin92 3y ago>Everything ever written to the Bitcoin blockchain is still available This isn't useful for 99% of stuff and pushing every video and music file on earth through a global state machine with the performance characteristics of an Atari from the 80s would render the thing inoperable. The entire Bitcoin network has a bandwidth of like 1mb every 10 minutes, the total size of the blockchain is half a TB in total, people torrent more porn in the time it took me to type this. Maintaining a global, complete history of transactions only ever made sense for one problem, double spending, and is utterly useless for sharing files.
- xtracto 3y agoThey dont. Do a search of something older than 5 years in btdigg and you will most likely get only dead magnets.
- xnyanta 3y agoThey do on private trackers where there is an incentive usually tied to ratio or seed time. It's not a monetary incentive and it works.
- xtracto 3y agoAaah private trackers! I remember once I pondered to enter one of those "special groups" but bailed when I read that you had to study for some sort of interview that was required to try to join . Lol no... I dont like interviewing for a new job, why would i agree to get tested for something as stupid as piracy? (Unless... mention me ONE private tracker that doesn't have piracy). So for 99% of people, my point stands.
- nephanth 3y agoI remember what.cd had interviews like that. Tried and failed as a kid, that was a pain There are definitely private trackers that don't have anything like that though (iirc they're called "semi-private trackers"). One i remember using is t411 when it was still running
- WeylandYutani 3y agoSharing is caring!
- qersist3nce 3y agoCan you explain bit more? Isn't the dump of last RARBG magnet links on the order of MBs? We can just download it and grep in plain text. I don't get what is the role of SQLite or IPFS here.
- romnon 3y agothis, anyone above 20 can operate.
- phiresky 3y agoThis blog post explains how it works: https://phiresky.github.io/blog/2021/hosting-sqlite-databases-on-github-pages/ https://phiresky.github.io/blog/2021/hosting-sqlite-database... Disclaimer: I wrote that article and was somewhat involved in the other sqlite over ipfs project this is forked from. Yes, for MB size files just downloading the whole thing will be faster and much easier - even if running in the browser. I'd say the boundary is somewhere around 10MB compressed (~20-200MB uncompressed). Looks like the sqlite dump used here is ~400MB in size, ~180MB compressed. Loading that in the browser would probably work but it wouldn't be too great.
- runeks 3y ago> Isn't the dump of last RARBG magnet links on the order of MBs? As I understand it, the purpose of using SQLite is indexing and querying, ie. being able to efficiently search through the data via a website.
- remram 3y agoIPFS is distributed but not anonymized, so you can send abuse requests to people's ISPs to take content down (like with torrents). The HTTP part is also not censorship-resistant. ipfs.io has a DMCA process, and they could also be asked to reveal the IP of users.
- activiation 3y agoUse Tor?
- tylersmith 3y agoIPFS can be accessed through Tor immediately through a gateway, and with a little work through the ipfs client directly.
- remram 3y agoTor+IPFS is much more resistant yes.
- bscphil 3y ago> you can send abuse requests to people's ISPs In practice it's very rare for me to see a direct ipfs protocol link, almost all the traffic goes through HTTP gateways (which frequently cache the content as well). Hard to imagine that they don't become a target for "hosting" pirated content if / when IPFS becomes more than a negligible platform for piracy. (A significant amount of Library Genesis traffic is already using IPFS via these same gateways.) As you mention, there's a DMCA process for some of the gateways, but that might not be enough to ward off attention.
- jazzyjackson 3y agoit's content addressed, if an ISP was so keen it would be simple to blackhole requests for a particular file (of course, one need only to change 1 bit to get a new content hash, but you have to redistribute the new file from scratch
- dietr1ch 3y agoI don't know about how IPFS is implemented, but you could use content-addressed blocks underneath every file too. This way flipping a bit means that only one underlying block changes, and that the new file would share N-1 blocks with the previous one, making redistribution only require sharing a single block.
- SpaghettiCthulu 3y agoWell, wouldn't they just blackhole all the relevant blocks then?
- dietr1ch 3y agoYes. Probably there's no replacement for privacy and anonymity being baked in into the system.