13 ms·
Reddit overhauls upvote algorithm to thwart cheaters
- polysaturate 10y agoDoes it really thwart cheaters actions or just stop them from having a clear indication of their efforts?
- landr0id 10y agoThis change isn't to thwart cheaters... not sure where the article got that. It's a side affect of legacy code that was used to thwart cheaters that hasn't worked very well since Reddit has grown. Some additional info about it here: https://reddit.com/r/modnews/comments/5goxk4/upcoming_change_to_vote_scores/ https://reddit.com/r/modnews/comments/5goxk4/upcoming_change...
- SerLava 10y agoThat's sort of the same thing. If cheaters could instantly tell their bot accounts' votes are being ignored, they could simply make new accounts immediately.
- weed_smoke 10y agoThey should overhaul their censorship algorithm and boot out /u/spez.
- drops 10y agoUpboat algorithms should be the least of their worries right now.
- minimaxir 10y agoThis is mostly another fix of bad design that was added in Reddit's early years, but people have started to notice the aggressive vote fuzzing as it was calibrated for a much smaller userbase. At the least, this will break statistical analysis of Reddit data for awhile since the public datasets will not have their scores updated, which I in particular am not happy about. :p
- notatoad 10y agoComplaints like this are the reason companies are reluctant to release public datasets. They don't have any obligation to release data, but they do. It's a gift. If they have to consider "how will this change affect the consumers of our public data releases?" every time they make a change, they're going to stop releasing public datasets.
- minimaxir 10y agoFor clarity, the Reddit datasets are not released by Reddit itself, but scraped through the API. (More context/examples of what I do with the data: http://minimaxir.com/2015/10/reddit-bigquery/ http://minimaxir.com/2015/10/reddit-bigquery/ )
- notatoad 10y agoOkay, but reddit does also release some public data sets: https://github.com/reddit/public-data-sets https://github.com/reddit/public-data-sets
- minimaxir 10y agoAh, right, forgot about those. (Although, those are traffic aggregates and wouldn't be affected by changed in the score ranking)
- erikpukinskis 10y agoAn API is not scraping. Scraping is taking a loosely structure document with no agreed upon interface and extracting data. A relevant comparison would be Craigslist who will use legal force to prevent you using data you scrape off the site.
- vosper 10y agoDoes this mean you (or I if I want to do some analytics on Reddit data) will need to completely rescrape the site after scores are recomputed?
- EJTH 10y agoI wonder how they are pulling this off. I guess it takes stuff like account age into consideration. But I fear it is more based on what sub it originates from, context of the post etc. It will be their go to excuse for why content is censored off the front page now. It has been problematic to excuse away the censorship lately, so this is a nice catch all excuse they just made here.
- colonelxc 10y agoThey didn't "just make" anything. They've had vote fuzzing, shadow banning and more from early days. As both the techcrunch post and the actual reddit post say, the rules around it were complicated and hard to reason about. They've basically refactored and come up with a simpler set of rules.
- chrismarlow9 10y agoI even recall a vulnerability write up where someone figured out that by using the "Show me posts with more than X upvotes" feature and a counter you could determine what a posts real score was.
- justinlaster 10y agoWe need to lay to rest this ridiculous notion that reddit is actively censoring anyone. A few subs have hosted outright illegal material, harassed users on and offline, and ruined the general ecosystem in the rest of reddit. The admins have reacted accordingly... sometimes. The bar to get out right banned from reddit is absurdly (and needlessly, in my opinion) high. However, these specific changes have been planned for a while now, it was one of the principal topics of interest when spez came back. There is no "catch all excuse", it's been in the pipeline before people confused free speech and system abuse of a private website.
- koolba 10y ago> We need to lay to rest this ridiculous notion that reddit is actively censoring anyone. They have code targeting specific subreddits to actively prevent them from being on the front page. While not totally censoring those people, they are putting their fingers on the scale which many see as a form of censorship.
- pselbert 10y agoEvan Miller did some very interesting analysis of the historical Reddit hot formula. It doesn't address cheating, but it does identify the details of the algorithm and some inherent faults. http://www.evanmiller.org/deriving-the-reddit-formula.html http://www.evanmiller.org/deriving-the-reddit-formula.html There is also the followup about ranking news items with upvotes: http://www.evanmiller.org/ranking-news-items-with-upvotes.html http://www.evanmiller.org/ranking-news-items-with-upvotes.ht...
- mark242 10y agoI still don't understand why, after having grown to a sufficient size, Reddit doesn't just enforce two-factor at account creation time. Tie a user to a phone number at the very least.
- detaro 10y agosounds like a surefire way to get rid of most of their user base.
- wu-ikkyu 10y agoA lot of people would rather not give reddit their phone number.
- schwap 10y agoThat seems to me to pretty severely contravene reddit's basic philosophy.
- binarymax 10y agoBecause having anonymity on public forums is important.
- smrtinsert 10y agoThese days it seems like an illusion with respect to government oversight, and having a username is a simple way to anonymize yourself against your peers. I'm all for it since it seems like it would reduce trolling.
- thomasahle 10y agoIt seems that every time somebody have wanted to find out who a user is, for lynching say, it hasn't been a big problem to find out who people are?
- jstanley 10y agoTying a user to a phone number does nothing but invade the privacy of most users, and slightly increase the costs for those who value their privacy. Source: at https://smsprivacy.org/ https://smsprivacy.org/ I run an online service offering completely anonymous phone numbers for ~£3/mo. And note that you only need 1 month in order to get the account validated. Most places check the phone number once at account creation time and then never again.
- gohrt 10y agoSilly that the announcements give so much attention to scores going up (due to a change in scale) and not to the content of the change. It would be trivial to keep the scale magnitude the same by multiplying by a factor ("old average frontpage post" / "new average frontpage post") or applying a logarithmic transform. Makes me think that they are intentionally kicking up dust around the scale change, to draw attention away from the substantive changes to weighting/ranking. https://www.reddit.com/r/modnews/comments/5goxk4/upcoming_change_to_vote_scores/ https://www.reddit.com/r/modnews/comments/5goxk4/upcoming_ch... https://www.reddit.com/r/announcements/comments/5gvd6b/scores_on_posts_are_about_to_start_going_up/ https://www.reddit.com/r/announcements/comments/5gvd6b/score...
- ozpri 10y agonow what are they doing about that censorship issue...
- dbg31415 10y agoSeems like just more censorship geared at shutting down people who support Trump. Timing is suspicious... they need to stop trying to have it both ways. Either ban Trump or get over it.
- jamespo 10y agoor do what they want as it's their website
- deleted 10y ago[deleted]
- rokosbasilisk 10y agobad argument. we dont let bakers discrimate against gay people. being a private business, doesnt mean you can do whatever you want. Edit: I agree with the posters below me. My point is a private business doesnt mean I can do whatever I want. There are still social rules and laws that need to be considered.
- burkaman 10y agoBecause gay people face systemic societal discrimination, so we have made them a legally protected class. Private businesses are free to ban or censor whoever they want as long as they aren't targeting a protected class.
- dpark 10y agoBakers can discriminate against you for your political beliefs. Political party affiliation is not a protected class.
- covercash 10y agoSpeaking of bad arguments... supporting Trump is a choice, you aren't born that way.
- deleted 10y ago
- lintiness 10y agoso instead of editing user posts, they're going to change the scoring to prevent the political sub they don't like from filling the front page.
- rm999 10y agoIt's pretty clear to me that Reddit has always lacked a solid experienced science-driven data person. Someone who can pinpoint an issue, formulate the issue into a product-driven concrete problem, come up with hypotheses on how to fix the problem, then use their vast wealth of data and users to test and/or implement them. It's not just the ad hoc unintuitive "solution" they came up with to mask votes (which most people agreed was a user-antagonist step in the wrong direction). It's a lot of things: their inept response to spam/vote brigading/other abuse; their lack of personalized content discovery (state of the art from 10-15 years ago would probably suffice). I could go on, as a product-driven data scientist who has been on reddit since the early days, I'm constantly struck by how little they do with the amazing data they have.
- binthere 10y agoCould you elaborate on "their lack of personalized content discovery"? I'm usually on the fence of bringing personalized content on platforms where you usually want to remain anonymous.
- rm999 10y agoIt could be as simple as "Hey, we noticed you spend a lot of time on r/gaming and r/frugal - might we suggest r/gameDeals?". Or perhaps even just filling some of the front page with threads from subreddits that may interest the user. I think there'd be a lot of interesting discovery available to reasonably active users of reddit. (I've spent a significant % of my career on personalized recommendations, and in my opinion reddit's product is close to ideal in many regards).
- minimaxir 10y agoAs a proof of concept, I made a simple related subreddit finder using solely the commenting data of users: http://minimaxir.com/2016/06/reddit-related-subreddits/ http://minimaxir.com/2016/06/reddit-related-subreddits/ The "like X subreddit and Y subreddit? Here's Z" is not infeasable to do with ALS on a similar dataset, but requires a better computer than I have. :p
- jedberg 10y agoSince I can't really say more than this: there's a lot of misinformation and misunderstanding in these comments. Don't believe everything you read on the internet and don't believe the conspiracy theories that this has anything to do with censorship or surpressing political (or any other) discourse. It's really just making the math less complicated.
- rokosbasilisk 10y agoTrust is a fragile thing. Spez broke it repeatedly, even Ellen Pao said she would have fired him for editing user comments. Cant say I blame people for being paranoid.
- criley2 10y agoThe people who's "trust" was broken are paranoid conspiracy-mongers who are provably nasty actors who use any opportunity to spread anti-establishment vitriol. Their paranoia is not justified, not to the extent of the conspiracy that they so routinely engage in. Just this week a man brought a rifle into a restaurant a fired a shot because of the conspiracy and vitriol of that side of reddit.
- rokosbasilisk 10y agoWell thats just not true, the community managers and ellen pao understood the repercussions of it. It destroys the legitimacy of all parts of the site and enflames conspiracies even more. People are not stupid, my first thought was how many times did he do this without getting caught.
- gdulli 10y agoReddit is a content management system for stupidity and spam. Let's not pretend it's some pristine, important institution. Trolling the_donald could only have been a step in the right direction.
- 10y ago
- toxican 10y agoIt doesn't help that the CEO admitted to editing Trump supporter comments. I mean I couldn't care less about those people, but that is censorship and suppression and I can't blame people for viewing anything reddit does from now on with a bit of skepticism. But obviously it's not that bad because they've still chosen to make reddit their home.
- talmand 10y agoWhy the downvotes? The CEO did admit to committing such anti-user actions.
- orf 10y agoBecause it wasn't censorship or oppression.
- throwanem 10y ago"Suppression" was the word used. But calling this action censorship or suppression is beside the point. It's one thing to prevent opinions one finds unsavory from being visible. Whatever one's own opinion on such activities, we can all agree that it's within the realm of what's reasonably permissible for a company that runs a site where others can comment. It's a quite different, and much more dangerous, thing to instead secretly modify comments expressing those opinions so that they say things other than the person who posted them actually wrote. In a purely legal sense, at least as far as I know, that's every bit as permissible as deleting such comments. In an ethical sense, they are nothing alike, and I don't think there is anything political in the statement that a company where someone has admitted engaging in such behavior, and not been immediately terminated as a direct result of it, merits extraordinary skepticism with regard to all its future doings.
- minimaxir 10y agoAt best, it's off-topic.
- 10y ago
- jordigh 10y agoCan someone explain to me the relationship between their public source code and what's actually running on their servers? I thought their voting algorithms were all public, but there are no commits here indicating any voting changes. https://github.com/reddit/reddit https://github.com/reddit/reddit
- rjbrock 10y agoTheir anti-spammer code is the only code that is not published as open source
- talmand 10y agoGotta keep the secret blacklist secret.
- robwilliams 10y agoIt would be trivial to test whether a site is blacklisted, that's not why the anti-spam code is private.
- talmand 10y agoWhy does it seem like people are assuming negativity in my post? I do think the secret blacklist should be kept secret.
- twblalock 10y agoDoes anyone believe the vote fuzzing ever really worked? It seems to me that people who wanted to mass upvote/downvote a post would do so despite the vote fuzzing.
- Terr_ 10y agoI thought a large part of fuzzing and vote-detail hiding was to deny bots/users any immediate/unambiguous feedback about whether they'd been detected and had their influence secretly neutered.
- xnull2guest 10y agoMy trust is broken. Am I a provably nasty actor who ... etc? My trust has been broken repeatedly, by things like the Snowden documents (and the media coverup of its contents) and Iraq War propaganda (with media participation), and yes by gamed use of scoring algorithms and selective/politicized moderation of social media. My trust was particularly broken when Facebook censored (literally did not allow me to post) Snowden documents. When I see media coverage today of, let's say Syria, and see all the ways its spun and partially covered, it's hard for me to have faith in the rest of what's being said. And - regarding censorship of let's say even the most vitriolic of activity or just plain widespread belief in certain communities of certain facts - do you want a Trump Administration (or really any state police) to be in charge of that? I was criticized as being a paranoid conspiracy monger for speaking about US government surveillance before Snowden, and for being vocal about the fact Saddam Hussein had nothing to do with 9/11, wasn't connected to Anthrax, and didn't have weapons of mass destruction. People called me paranoid, vitriolic and a 'truther', creating a straw man of my case and finding every reason not to listen to what I had to say. A million people dead and a destabilized region later, with a vacuum filled by religious extremism exploited for proxy war - and still people can barely muster up a revision to their earlier perspective and an admission that the Iraq War was not only illegal, but a war of choice, a war of aggression and one bolstered by an extremely efficient and systemic capability to propagandize not only the American people but all audiences of US broadcasting. I have good, justified reasons to have broken trust. Today I trust, but I verify. And I continually find spin, mis- and dis-information playing a huge role in public, 'polite' conversation. I dislike being called a paranoid conspiracy monger (again) by the implications of your comment. I watched Reddit transform after it got acquired and Twitter transform after it fell to State Department pressure. I've watched Facebook game its results for a long time, as it has every legal but no moral right to do. My trust has legitimate reasons to be broken, and invoking 'conspiracy mongering' as an explanation heals no wounds and does not move the community closer to solving the credibility problem of public information services.
- criley2 10y agoFrankly, I don't believe your post. It's such a wishy washy amalgamation of "of course I was right" rose tinted steps through the past, each stop complete with ham-fisted "they called me all the worst things but I was right". No story is that perfect. You aren't that perfect. And writing this long of a post to try and convince me that conspiracies like Hillary Clinton engaging in a pedohpile sex ring are true because you believed the Iraq War wasn't about WMDs is just stupid. When we take into the fact that President-Elect Trump used to party with Pedophile Jeff Epstein, and 3 years ago went as far as to praise Jeff's young taste in women, the fact that Jeff Epstein had 13 separate numbers for Mr Trump... I guess we're in Trump's America now. I can't stop you from fellating yourself regarding your overwhelmingly pretentiously perfect view of yourself throughout the past decade, so I guess I should join you. Trump's a pedo and anyone who doesn't see it, sling your arrows at me, the truth will be visible later rather than sooner, and I'll be posting lame, rose tinted "I was right the whole time" posts trying to contradict the next anti-conspiracy poster :) I can't beat you and your "I was always right so conspiracies are legit" nonsense, so I'll join you! That's Trump's America. We can't beat the misinformation. Facts lose. Feels win.
- xnull2guest 10y agoIt would be nice to have a clearer understanding of how the algorithm works, and how it purports to stop vote manipulation from state actors, like the capabilities of the GCHQ and NSA from the Snowden documents or the astroturfing contractor centers for the DoD (Earnest Voice, etc). I'm thinking maybe the algorithm changes slightly alter some brigading from communities, but probably can't handle state-sponsored manipulation.
- fabian2k 10y agoOne aspect I don't understand is why Reddit allows new accounts to vote from the beginning. You don't even need to verify an email address, you can just start voting (unless they're doing something sneaky and ignore those votes). I'm comparing this to Stack Overflow, where you need 10 reputation to vote. This is a pretty trivial barrier, but it does mean that you need to put more effort into each sock puppet to be able to commit vote fraud. You also can't have "invisible" socks all that easily, you generally need to post something to get the upvotes for your socks, which results in more obvious patterns that users, moderators and automated systems can detect. Fighting vote fraud when it is that easy to create new socks that can vote seems like a pretty hard problem to me, especially on the scale of Reddit.
- scott_ni 10y agoOn the other hand, requiring reputation could incentivize spamming and worthless posts. For example, if you already have an automated voting bot, why not make it upvote your new bot accounts to transfer "rep" and allow more upvotes?
- fabian2k 10y agoThat is one of the things I meant by "more obvious patterns". That works of course, but you also create connections in the other direction now as well for your vote fraud. There is another effect that probably doesn't apply to Reddit, but on Stack Overflow it can be pretty noticeable if you upvote crappy posts by your socks too much, and someone will investigate.
- deleted 10y ago[deleted]
- komali2 10y agoI don't understand the idea of "preventing a cheater from seeing votes." The only way I can think to "cheat" reddit votes is to just throw a bunch of bots at a post. Presumably, one knows how many bots one has. If the idea is you don't know which bots are shadowbanned and which aren't, it would be trivial to just have your own private subreddit that the bots post in regularly, and see whose posts become visible to other accounts.
- brilliantcode 10y agoThe real urgent problem is sockpuppeteers using purchased accounts which makes it difficult to see who is legit or not. They can influence and censor people they don't like. You see a lot of this going on over at /r/ethereum, where certain submissions receive high number of upvotes but little to no comment activity apart from obvious sock puppetry creating fake conversations. Comments pointing this out are quickly downvoted to oblivion or flagged. The anxiety from Reddit is obviously clear. Their user base premium is losing it's value from an investors point of view. Mindless banters you see on Youtube are what makes up Reddit's audience with occassional anecdotal experiences that show up. Pornhub has ton of users but are they valuable as Facebook users? I feel like there's going to be a market correction in the quantity over quality type of social network websites who've ramped up userbase but have not extracted tangible value apart from delivering shaky metrics that advertisers are now beginning to raise questions. It seems like the only ad platform that stood test of time is Adwords but as a small advertiser I'm turned off by the prospect of paying $1+ per click.
- kbenson 10y ago> Admin KeyserSosa Is it me, or is it weird to see what are likely a names chosen when someone is adolescent or at least interacting in a non-professional capacity making their way into professional contexts, especially when they refer to another person, real or fictional (even if slightly changed)? Are the corporate executives of the next generation going to go by the aliases the likes of BillGaytes and BarackOsama?
- matt4077 10y agoIt's mostly you. Or maybe it's me. I hate nothing more than the complaint that something is "unprofessional". It's a completely meaningless concept. If there's something actually wrong in how someone is acting, it's completely ok to call them out. Example: "'BillGaytes' and 'BarackOsama' are insulting to Bill Gates, Barack Obama, and the gay community. It inflicts harm on people without justification, and I expect you to change these aliases" Note how none of that applies to "KeyserSosa".
- kbenson 10y agoI think I just chose some poor examples and used some an unfortunate set of words, because that's not really along the lines of what I was talking about. I actually wasn't focusing on the names being insulting, and wasn't meaning BillGaytes to have any gay commentary, I just thought of a famous name, and then an alternate spelling that sounded the same, and didn't think of that affiliation at all at the time (I noticed a few minutes later when re-reading it, and almost edited it to point out that it wasn't my intention). BarackOsama I thought of just because Osama sounds like Obama, and then it seemed like something someone might use because of the affiliation so seemed a more realistic choice, but I didn't really intend for the focus to be on the names having negative connotations to be part of my point. Really, it's more that it feels weird to have someone go by someone else's name, or some other artist's creation, and that's only a little alleviated by an alternate spelling. It's not about being "professional", I think, but about it being public. It's like the person is laying some claim to that other person's identity or creation through the name, and while in a limited context that feels acceptable, it feels weird to me when it's more public, as in a news post, or expressed to millions (or billions!) of people through that person's prominance. I'm using the word "weird" because I can't really pin down what's causing my feelings about this. That may point towards it being some misfiring emotional attachment to a concept that doesn't really have a rational explanation, or there may be a rational objection that I'm having trouble formulating but my gut is catching. I'm not sure, which is why I'm trying to explore the idea here. where I might get some input to solidify my thoughts.
- deleted 10y ago[deleted]