3 ms·
TLDR 30% of http requests are bad bots, 17% are okay bots, and 53% human. The PDF report isn't explicit, but since their assertion is "based on data collected
by idoubtit 3y ago
TLDR 30% of http requests are bad bots, 17% are okay bots, and 53% human.
The PDF report isn't explicit, but since their assertion is "based on data collected from the company’s global network throughout 2022, which includes 6 trillion blocked bad bot requests", it means the "internet traffic" is measured in number of HTTP requests. As noted in other comments, results would have been very different with network bandwidth.
BTW, I haven't checked if the search bots behaviour has recently changed, but I remember that most of them ignored the directives in robots.txt asking for a slower crawl. And I couldn't find a way to declare that the content almost never changed.