3 ms·
Because it means you're a bot with a default user agent, and they've probably had some bad experiences with those. Well-behaved bots use descriptive user agent
by duskwuff 6y ago
Because it means you're a bot with a default user agent, and they've probably had some bad experiences with those.
Well-behaved bots use descriptive user agents.
- oh_no_not_again 6y agoRight. But why Java default user agent, and not Python request's, libwww-perl or curl itself? Is there disproportionately more bad bots written in Java? This is not-intuitive to me, so that's why I posted this :)