3 ms·
I'm having a little trouble parsing this comment. > Search engines/a publically traversable & reality reflecting of the physically accessible WWW is by design
by Terr_ 2y ago
I'm having a little trouble parsing this comment.
> Search engines/a publically traversable & reality reflecting of the physically accessible WWW is by design outlawed. DMCA saw to that.
Do you mean in the sense that the DMCA forces everyone to censor their data on demand, and therefore data cannot be both accurate (containing certain items) and public?
> Now, if you want that, you have to spider.
Isn't "that" already the same thing as "spidering"?
Or do you mean that "you" (i.e. the data consumer) have to do your own in-house spidering, because nobody is allowed to centralize the work and then redistribute (complete) data?