4 ms·
> Is it ethical to scrape things, trying to bypass prevention methods, against the expressed wishes of a site? No, but many sites only allow Google to index th
by redis_mlc 5y ago
> Is it ethical to scrape things, trying to bypass prevention methods, against the expressed wishes of a site?
No, but many sites only allow Google to index them now.
I don't think that was the original plan for the web.