3 ms·
> In any case, web scraping is a sort of gray area of the law. I feel like it's also only a matter of time before we have decentralized web scrapers that can c
by dheera 3y ago
> In any case, web scraping is a sort of gray area of the law.
I feel like it's also only a matter of time before we have decentralized web scrapers that can consume data and assemble datasets and store the results in a decentralized fashion in a way that is completely non-enforceable. LinkedIn data would be aggregated in all sorts of interesting ways, and there would be literally no name you could sue, no address you could serve papers to, it would be a hundred thousand bots in 100 countries that collectively assembled the dataset and put it on some IPFS or torrent.
If data is visible with human eyes, it's visible by decentralized bots, the only missing piece is the technical and financial complexity of the current state of decentralized compute.