4 ms·
It only challenges user agents with Mozilla in their name by design, because user agents that do otherwise are already identifiable. If Anubis makes the bots ch
by rezonant 11mo ago
It only challenges user agents with Mozilla in their name by design, because user agents that do otherwise are already identifiable. If Anubis makes the bots change their user agents, it has done its job, as that traffic can now be addressed directly.
- hshdhdhehd 11mo agoWhat if everyone requests from the bot has a different UA?
- skylurk 11mo agoSuccess. The goal is to differentiate users and bots who are pretending to be users.
- trenchpilgrim 11mo agoThen you can tell the bots apart from legitimate users through normal WAF rules, because browsers froze the UA a while back.
- hsbauauvhabzb 11mo agoCan you explain what you mean by this? Why Mozilla specifically and not WebKit or similar?
- gucci-on-fleek 11mo agoDue to weird historical reasons [0] [1], every modern browser's User-Agent starts with "Mozilla/5.0", even if they have nothing to do with Firefox. [0]: https://en.wikipedia.org/wiki/User-Agent_header#Format_for_human-operated_web_browsers https://en.wikipedia.org/wiki/User-Agent_header#Format_for_h... [1]: https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/User-Agent#syntax https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/...
- samlinnfer 11mo agoThis has basically been Wikipedia's bot policy for a long long time. If you run a bot you should identify it via the UserAgent. https://foundation.wikimedia.org/wiki/Policy:Wikimedia_Foundation_User-Agent_Policy https://foundation.wikimedia.org/wiki/Policy:Wikimedia_Found...
- 1vuio0pswjnm7 11mo agoIt's only recently, within the last three months IIRC, that Wikipedia started requiring a UA header I know because as a matter of practice I do not send one. Like I do with most www sites, I used Wikipedia for many years without ever sending a UA header. Never had a problem I read the www text-only, no graphical browser, no Javascript