6 ms·
Why isn't HN plagued with bots like some other websites?
It's fairly easy to create a new profile on HN. And no CAPTCHA is asked.
Yet, the quality of discussions is often really high, and I usually learn more from the community than the articles themselves.
Is HN bot-free mainly due to the niche audience it's targeting, or is it because the community is good at downvoting useless bot comments?
I think we should appreciate @dang's and other maintainers' efforts, too.
- slater 5y ago> Is HN bot-free mainly due to the niche audience it's targeting, or is it because the community is good at downvoting useless bot comments? Both.
- devKnight 5y agoThere are bots that scrap for emails on the monthly who's hiring etc posts. Made the mistake once of posting my email in the original formatting, got some funny scam emails. So they are still around
- gabrielsroka 5y agoHonest question, if I write name at example dot com have the bots not figured out that 'dot' means '.' and 'at' means '@' ?
- Shared404 5y agoI've had a few hit emails formatted like that, though not from HN.
- ecshafer 5y agoI can't see that being that difficult personally. You are already searching for string + @ + string + .com, string + at + string + dot + com isn't exactly rocket science. I have seen some people doing things like //\\//name\///at\\\///domain///\\com which might be more unexpected, and therefore might help. But any practice if it becomes common will be seen through.
- ransom1538 5y agoDo things like [myhnusername] @ gmail.com Which implies to replace [myhnusername] with their HN username. I used to scrape - this is not worth the time to fix or patch for.
- smt88 5y agoFor most people, it doesn't matter at all if their email address is posted publicly like that. Any email address that someone has used to sign up for services for years is going to have been leaked anyway. There's very little value to just a plain email address with no password, no context, etc. If you posted your (let's say) Gmail address on HN, the spam level of your inbox wouldn't change. Gmail might work a bit harder filtering out some spam, but it would be lowest-common-denominator stuff that they easily recognize.
- shusaku 5y agohttps://xkcd.com/1808/ https://xkcd.com/1808/
- Tabular-Iceberg 5y agoMaybe they don’t want those email addresses anyway. People who are aware of spambots may not be the ripest targets for spam, so it’s not worth the cost of targeting them.
- codingdave 5y agoThey haven't figured out what spaces are. I have just been putting a space before and after the @ for years. No spam problems. My guess is that spaces are so prolific that having to parse out every space in a page and then whether they are near special characters or keywords just isn't worth the trouble.
- AnimalMuppet 5y agoAdd a third reason: moderation. If dang sees too much garbage coming from an account, he'll ban the account. And he knows when people create new accounts to escape the ban. I haven't heard him say so, but if it gets too spammy, I presume that he'll block the IP.
- rdtwo 5y agolol did you just say ban the ip like it means something in the age of modern bots and web scraping
- giantg2 5y agoI think part of it is the content isn't particularly useful for a bot to act on (not pushing products, not a lot of politics, etc). Another could b the audience is tech savvy, so they're less likely to fall for bot stuff and more likely to report it. Then the moderation is higher quality than many other sites. Finally, the overall population here is low, so it's a smaller target. That said, I do occasionally wonder if certain of the comments are from real people. Although an occasional comment from me could have others thinking the same.
- adamrmcd 5y agoNow I'm curious. What is the overall population of HN?
- giantg2 5y agoI think @dang can answer that. A few years ago it was about 300k unique daily views. Inwoukd guess it's around 600k now. So not really small, but small relative to Facebook, Twitter, Reddit, etc.
- gabrielsroka 5y ago5 million per month as of 2019. https://www.newyorker.com/news/letter-from-silicon-valley/the-lonely-work-of-moderating-hacker-news https://www.newyorker.com/news/letter-from-silicon-valley/th...
- garry 5y agoOne answer: @dang
- throwaway0a5e 5y agoI know mod-worship is fashionable around here but... bullshit. One mod wasn't sufficient to keep bots at bay on a podunk PHP forum with hundreds of members 15yr ago. It's not sufficient to stem the tide of far, far better bots that lurk the internet today. There's other mechanisms at play.
- giantg2 5y agoSounds suspiciously like something a bot would say to have us let our guard down...
- jjgreen 5y agoAs does this: it's bots all the way down ...
- tomcam 5y ago> There's other mechanisms at play. And they are…?
- throwaway0a5e 5y agoIt's a bunch of people who have the critical thinking skills required to spot bots (not saying they used them). Nothing is bought, sold or recommended to be bought or sold here. It's already somewhat of an ideological echo chamber and it's not really a place for mass market news and trends so few are coming here looking to be informed about things the people buying bot time care about. So basically it's a tough nut to crack for little gain. Why bother when you can write Reddit bots that are far more impactful and will earn far more money. Edit: Yes I know stuff is recommended to be bought or sold here. It's absolutely nothing compared to Reddit where you can pimp viral content for a brand as top level content and where you have subs that are specifically about consumerists things (what X should I buy type subs).
- fragmede 5y agoTurn on showdead in your profile and browse new sometime. there's plenty of spam that hits this site, you're just not seeing it.
- throwoutway 5y agoI started flagging things on new that are obviously spam. Hope I am helping!
- FrenchDevRemote 5y agoYou can see a few bots when browsing new. They get flagged in just a few minutes usually. (also, they shadowban people a lot sadly, it's hard to use throwaways sometimes)
- thomassmith65 5y agoThey get flagged in just a few minutes usually. It does wonders for community morale to have a site deal, in a timely manner, with blatant garbage. I no longer visit other social media, but I remember the feeling of impotence upon seeing nothing happen after you report a quadruplicate post, or unhinged death threat, or troll piffle, or disingenuous attempt at self-promotion. Elsewhere, some users end up with learned helplessness and just accept the site is 50% shit; other users end up being hyper-vigilant and add to the noise with rants and accusations. Here on HN mods and reasonable users still have control.
- BMc2020 5y agoThere are certain metrics that can be used, such as the ratio of upvotes to comments. I red it somewhere that a post with 100+ upvotes but no comments can be spotted programatically. HN I see sometimes where it isn't the link that's the goal, it's the top comment for the link. So the OP is a bot with a clean record but the top commenter is the narrative pusher. Plus there's the good old link to the blacklisted but unbanned topics. Check out J**n P***n's spam and they aren't blocked but the accounts that post them get a strike. It's a moving target and they get better all the time. I red it somewhere that you could post about i*l and p***e and in minutes the bots would appear, but the i word has gotten a lot more sophisticated lately. Their s emm emm operation is among the best in the world. Lastly, many state actors are very good on offense (S and the I word) but everyone is terrible on defense. It's still the wild west out there and the bad guys are winning. My $0.02 YMMV
- decremental 5y agoA post with 100+ upvotes but no comments is just any sufficiently technical article. It's not uncommon so I'm not sure that's a useful signal.
- yesenadam 5y agoSo much of that seems redacted, for some reason, that I couldn't make much sense of most of your comment. Or maybe it was joke I missed or something?!
- aaron695 5y ago
- nojs 5y agoSpamming is a cost/benefit decision. The cost of spamming HN is insanely high (because any non-substantive low effort content gets downvoted and hidden, meaning you need to hire spammers or bots with CS PhDs essentially) and the benefit isn’t that high (because the moderation system works amazingly well and any spammy content, even if we’ll disguised, probably won’t last long). The same is not true of, say, Reddit, where you can build up karma posting jokes and cat pictures, and where there is higher mass market potential for shilling products. Even if you had a magic bot that evaded dang and all the downvoters, your ad for weight loss pills will fall on deaf ears. It’s just not the right audience.
- brudgers 5y agoOne of the first things Paul Graham wrote in Arc was a Spam Filter. http://www.paulgraham.com/spam.html http://www.paulgraham.com/spam.html That was twenty years ago (about). Before spam filters were common and when spam was just getting started. Back when spam filters they were cutting edge. I suspect it has kept pace and that’s why HN has so little spam…but that’s just a guess.
- NGRhodes 5y agoWe are superior bots.