2 ms·
There are a LOT of bots and crawlers with bogus browser user agents. Some of the bad ones you can select see indirectly in logs because they pick UAs that almo
by eli 6y ago
There are a LOT of bots and crawlers with bogus browser user agents.
Some of the bad ones you can select see indirectly in logs because they pick UAs that almost no one uses any more. Go search your logs for IE8 or Firefox <= 70.0. Most just pick a random modern User Agent though and that's awfully hard to see in server logs.
- colechristensen 6y agoYeah, but so what? There are plenty of blacklists maintained for all sorts of things, and no metric is perfect. Some really rudimentary filtering or AI methods could get you pretty good data.