5 ms·
As a former moderator of some relatively large channels | forums semi frequently subjected to both edge lord raids and the glacial perverse machinations of the
by defrost 3y ago
As a former moderator of some relatively large channels | forums semi frequently subjected to both edge lord raids and the glacial perverse machinations of the slow troll I have one question:
To find the most trusted peers, we use Appleseed, a peer-reviewed algorithm and trust metric which was proposed in the mid 2000s by Cai-Nicolas Ziegler and Georg Lausen from the University of Freiburg. Appleseed operates on precisely the kind of weighted graph structure we have described, and it is also guaranteed to converge after a variable (but finite) number of iterations. Appleseed, once converged, produces a ranking of the most trusted peers.
Appleseed produces its rankings by effectively releasing a predefined amount of energy at the trust source, or starting node, and letting that energy flow through the trust relations. The energy pools up in the nodes of the graph, with more energy remaining with the more trusted peers. After the computation has converged, each peer has captured a portion of the initial energy, where the peer with the most energy is regarded as the most trusted.
Now that this mechanism is out in the open, how robust is it in the face of a determined attempt to deliberate game the system?
ie: Can I become the most trusted for that one glorious moment of ripping the table cloth out from under everybody?
- camgunz 3y agoYeah systems like this essentially just centralize power. For a failure case, see spam IP address blacklists. I think generally it's not a good model.
- cheschire 3y agoLet’s raise the stakes even further than discussion forums. Search for “eve online betrayal” or “eve online heist” and determine if this algorithm could’ve prevented those situations. Then raise the stakes more and consider the US presidential candidate nominations process. Push it to extreme situations, and finally in the end compare it to the Chinese social scoring system. This kind of journey of morals is what ultimately led to me transferring ownership of my own online community and walking away for good. It’s tough and I don’t envy the folks who keep up with these things.
- _heimdall 3y ago> Then raise the stakes more and consider the US presidential candidate nominations process. If there was any trust left here, the upcoming election cycle should have already destroyed it. The likely Republican candidate refuses to debate, the Democrats all seem to think the president shouldn't run again but won't stop him or allow a challenger, in all likelihood the two final candidates also won't debate each other, and we're left picking between two candidates that much of the country likely aren't happy with. That's neither democratic or trustworthy.
- kemotep 3y agoBoth parties are still running primaries. None of the races have happened yet so whether Biden or Trump get the nomination isn’t set in stone. In addition to the two major parties, there are several independent and third parties. Because they are not popular enough to win isn’t a condemnation of democracy. That’s how it works.
- _heimdall 3y agoThe Republicans are running a primary, though the candidate with by far the most support isn't taking part. Trump will be on the primary ballot and always loves hearing himself talk on an empty stage, but he's avoided debates entirely. That isn't the fault of voters or the party necessarily, though the party can and possibly should require candidates to take part in the primary process if they want to be on the party's ballot. The Democrats effectively aren't running a primary at all. There are technically two challengers[1], though there are no debates planned [2]. RFK was running on the ticket and had plenty of support in polls to warrant primary debates, though he's now running as an independent after what he viewed as a refusal by the party to allow a primary process to challenge Biden (his opinion, I can't vouch for inner workings of the DNC). [1] https://www.reuters.com/world/us/democratic-candidates-running-us-president-2024-2023-09-18/ https://www.reuters.com/world/us/democratic-candidates-runni... [2] https://deadline.com/feature/2024-presidential-debates-schedule-1235523892/ https://deadline.com/feature/2024-presidential-debates-sched...
- raphlinus 3y agoThat's the right question, and what my work a quarter century ago on "attack resistant trust metrics" attempted to answer. That's written up in a bunch of places, but I think probably the best starting point is my "lessons from Advogato"[1] talk in 2007. [1]: https://www.youtube.com/watch?v=d9gjy1OsTGQ https://www.youtube.com/watch?v=d9gjy1OsTGQ
- hot_gril 3y agoI don't think it works as long as people are fully anonymous. There's gonna a way to amplify yourself with fake accounts. The way a social network should work is, you only directly communicate with people you know IRL*, but it's easy to spread info across multiple hops. Each person along the way is self-moderating because they won't be scamming or harassing their real acquaintances. That's why OG Facebook without groups, pages, global recommendations, etc was actually very civil. Of course, that's not doable in a typical chat room setting. * Profiles don't have to be tied to real identities like on Facebook. Screen-names are fine as long as people know who's who, like on AIM.
- actionfromafar 3y agoI like it, how could one make it happen?
- hot_gril 3y agoI made my own social+news app following this model, but it's nearly impossible to market any kind of social media. Field is too played out. I gave up. Old Facebook already did it. Twitter could be it if there are no recommended / globally popular accounts and you just repost stuff you like. Both found it more profitable to shove stuff at people and create popularity contests.
- jstarfish 3y ago> Each person along the way is self-moderating because they won't be scamming or harassing their real acquaintances. LMAO. Bernie Madoff got started by roping in friends and family. Friends and family are literally the biggest targets in every MLM scheme. Family is frequently implicated in identity theft (they have access to your files). Gen-Z has figured out that they can scam their families and cry gay persecution from them to avoid accountability. The vast majority of rape cases (70-90%) are acquaintance rape. Real acquaintances are the most likely to be victimized in literally every form of crime, including murder. Trusted networks only function when people have decency and don't exploit their insider access. > That's why OG Facebook without groups, pages, global recommendations, etc was actually very civil. I'd argue it's because the networks were smaller, and no other reason. When you have a large family, you can afford to fuck over a few members and live with never being invited to Thanksgiving at their house again.
- terminous 3y agoThis "peer reviewed algorithm" is basically PageRank, or close enough for the following critique to apply: None of these algorithms are models that infer trust from raw content, aka there is no special sauce for trust here, it's just an information theory problem in the abstract. So Garbage In, Garbage Out. These algorithms are only good when you have a single, consistent signal of trust that you can trust. So it will have the same issues that Google has with SEO spam, and there's no graph-traversing algorithm to solve that, as it is an out-of-band issue compared to what these algorithms are designed to take as input. Take outgoing links to be your signal of trust, and you'll create a linkspam problem. So you need an anti-spam model that sits in front of this algorithm to detect violations of webmaster guidelines, aka gaming the system. So in other words, all you need to do to game the system is generate a bunch of accounts that publicly link to you, follow you, or whatever this systems' input of 'User A trusts User B' is. And not get caught by whatever anti-spam or anti-bot model they're using.
- dogcomplex 3y agoWhich is why we need Proof of Identity based internet infrastructure asap to verify people are real behind the avatar.
- woah 3y agoWon't stop the problem. There is an inexhaustible supply of real people who are willing to help game any system for ideology or entertainment.
- MichaelZuo 3y agoIt's trivial to store a ban list of several billion User IDs in memory. That's only a few tens of GB. As long as it can be guaranteed that one specific individual can only ever create one account, it's not a problem at all.
- tetromino_ 3y agoIn many countries there is already a market for buying and selling real world identities of penniless students and homeless alcoholics to use for nefarious ends, e.g. financial fraud or registering shell companies. Given enough financial incentive, Proof of Identity is insufficient.
- tshaddox 3y agoI’m not sure that any measure of trust could prevent someone from building up trust and then ripping the table cloth. You can only measure what you can observe, and short of something weird like a psychological profile I don’t think this could be in the scope of a trust metric. The only way I can think of to try to avoid this is to simply make it more lucrative to continue with good behavior rather than liquidate the trust you’ve built up.
- Nevermark 3y agoYes. Also, respond very quickly to recent trust issues, but slowly to long term trust issues. So any trust violation gets punished quickly & heavily, but has little lasting effect if turns out to be an isolated issue. It’s an interesting problem. I don’t see how we can keep scaling and increasing the value of social connections (high trust in useful networks has almost unlimited potential vslue) without automating & decentralizing the quality maintenance.
- anitil 3y agoI've never moderated a forum - what are 'edge lord raids' and 'slow trolls'? I'm sure I've come across them in reddit for example, but I'm not familiar with the terms and googling only gets D&D and fishing references.
- defrost 3y ago"Edge lords" are those that for whatever reason like to make uncomfortable contraversial remarks .. not for the genuine sake of discussing things that should be discussed in a measured way but for the goal of provoking drama, over reaction, chaos, confusion and distraction. The appearence of multiple relatively new users all pushing extreme takes that are on the edge or well over gets shorthanded as an edge lord raid - it's coordinated and can have multiple root causes from simple social drama to actual distraction with an ulterior motive (eg: prompting moderators into rushed counter reaction can expose passwords | permissions | inter operator side channel communications, etc). Slow trolls like the drama but dislike the boot .. they'll wheedle their way into communities and build a support network then pivot into being "that uncle at thanksgiving" .. you know the one. These are very rough descriptions, it's very much the case that you might not be able to pin particular behavious down but you'll know 'em when you see 'em.