4 ms·If bots could be forced to pay per crawl somehow, it would subsidize nearly all legit user traffic.by deadbabe 8mo agoIf bots could be forced to pay per crawl somehow, it would subsidize nearly all legit user traffic.