2 ms·
if a human is allowed to do something on a site, it goes to reason that a bot should be allowed too (granted using the same access frequency as a human). Block
by chii 9y ago
if a human is allowed to do something on a site, it goes to reason that a bot should be allowed too (granted using the same access frequency as a human).
Blocking scraping is like DRM. Don't do it. Use a legal mechanism to deal with copyright infringement, and use acceptable usage policy to deal with heavy users that are using more than their "fair" share of bandwidth.