3 ms·
That really depends, but the quick answer is that according to our human social contract, we'd just ask "how many can I take?". Until now, the only real tool to
by falcor84 7mo ago
That really depends, but the quick answer is that according to our human social contract, we'd just ask "how many can I take?". Until now, the only real tool to limit scrapers has been throttling, but I don't see any reason for there not to be a similar conversational social contract between machines.
- volemo 7mo agoIsn’t robots.txt such a “social contract between machines”? But AI scrapers couldn’t care less.