2 ms·
Without any documentation about how etiquette will be respected and sites won't be hammered, it's fair to be sceptical about the ethics. Not every crawled site
by mellosouls 3y ago
Without any documentation about how etiquette will be respected and sites won't be hammered, it's fair to be sceptical about the ethics.
Not every crawled site is "big tech" or even commercial.
- fastball 3y agoI don't disagree, but I also don't think "proxy rotation" immediately implies sites will be hammered either.
- mellosouls 3y agoFair enough. I may be too sceptical. But I note the OP has ignored prior comments instead of taking the opportunity to clarify. It doesn't reassure.