Y
HN Search
Hacker News Search
new
|
comments
|
top
|
jobs
oh_no_not_again
searching PlanetScale…
1.
▲
2.
▲
3.
▲
4.
▲
5.
▲
6.
▲
3 ms
·
1.
▲
by
oh_no_not_again
6y ago
Right. But why Java default user agent, and not Python request's, libwww-perl or curl itself? Is there disproportionately more bad bots written in Java? This is not-intuitive to me, so that's why I posted this :)
2.
▲
by
oh_no_not_again
6y ago
Nah, first I got very surprised, then did this post, then vent to sleep. Just tweeted at them.
3.
▲
DuckDuckGo returns 500 if user agent starts with “Java”
(pastebin.com)
3 points
by
oh_no_not_again
6y ago
|
5 comments
4.
▲
by
oh_no_not_again
6y ago
I wonder why. My guess is to prevent bots from aggressively scraping site generating useless load, but I failed to find any other user agent strings that lead to this behavior. Any suggestions?