3 ms·
If a bot's user agent doesn't look identical to a normal user, either the bot developer is dumb, or they are relatively well behaving. Anyone malicious who kno
by kube-system 3y ago
If a bot's user agent doesn't look identical to a normal user, either the bot developer is dumb, or they are relatively well behaving.
Anyone malicious who knows what they're doing will just send you a statistically common user agent string.
Under most http libraries this is a one-liner:
headers = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.0.0 Safari/537.36 Edg/119.0.0.0'}