3 ms·
Are crawler access patterns really that non-uniform across pages and large enough to make this a problem? And for crawlers that are not immediately indentifiabl
by account42 5y ago
Are crawler access patterns really that non-uniform across pages and large enough to make this a problem? And for crawlers that are not immediately indentifiable from the user agent? Are you sure you are not just counting users without JS / a blocker that interferes with your tracking / intermittent connections as bots?
If you really care what users like on your site why not ask them?