3 ms·
It's a shame they don't provide a list of blocked content. A public list of what their gateway will not retrieve for you would fuel the Streisand effect...
by londons_explore 4y ago
It's a shame they don't provide a list of blocked content.
A public list of what their gateway will not retrieve for you would fuel the Streisand effect...
- sva_ 4y agoYou can download the SQL tables including the hashes over at LibGen hxxps://libgen.is/dbdumps/
- moreresearchplz 4y agoBut those hashes are not identical to IPFS hashes as far as I know, sadly!
- eurasiantiger 4y agoDifferential crawling to the rescue!
- anecdotal1 4y agoMost people aren't aware that there are also like 20 different valid IPFS hash formats so they have to write code to generate blocks for all those variants or it is trivially bypassed. I had to do this for my IPFS gateway at my job.
- capableweb 4y agoAKA multibase + multihash AKA "self-describing base encodings" + "self-describing hashes" AKA https://github.com/multiformats/multibase https://github.com/multiformats/multibase + https://github.com/multiformats/multihash https://github.com/multiformats/multihash