5 ms·
> If someone chooses to use the same identity for discussing both firearms and (say) cooking, then they may get shunned by some cookery folks. It seems like yo
by pdonis 6y ago
> If someone chooses to use the same identity for discussing both firearms and (say) cooking, then they may get shunned by some cookery folks.
It seems like you're conflating two different kinds of things under "reputation".
If I start talking about firearms in a cooking group, obviously I'm way off topic and I should expect my posts to be moderated. If I start spouting insults, that's not just off topic but abusive and I should expect to be treated accordingly. And if I do those sorts of things in multiple forums, I should expect to get a global reputation for not being a good participant and suffer the appropriate consequences.
But if I come into a cooking group and just talk about cooking, why should the information that I'm also in a completely different group talking about firearms even be relevant? Why should "being a member of a group that talks about firearms" be part of my global reputation at all?
- kelnos 6y ago> But if I come into a cooking group and just talk about cooking, why should the information that I'm also in a completely different group talking about firearms even be relevant? Agreed, it shouldn't be relevant, but unfortunately it often is. People are so mired in identity politics that your affiliations outside of a particular group will often matter within that group. It's not fair and it's not rational, but that's what discourse has devolved to, sadly.
- pdonis 6y ago> People are so mired in identity politics that your affiliations outside of a particular group will often matter within that group. I understand that people are often like this. What I'm wondering is why Matrix would include such information in the reputation system they say they're building, since that basically just encourages people to look at irrelevant information and engage in identity politics instead of discouraging it.
- Arathorn 6y agoa filtering system which doesn't have the concept of identity sounds interesting; how would it work?
- Reelin 6y agoYeah, without the ability to query a particular identity it's not clear (to say the least) how you would go about filtering out malicious identities. To some extent, identity politics based on public associations is an unavoidable problem. Public data can be scraped so someone is probably going to aggregate and analyze it at some point. That said, it seems important that a reputation system not facilitate making associations that otherwise wouldn't have been visible. To that end, it's important to take care not to accidentally incentivize community moderators to leak information that otherwise wouldn't have been discoverable by the general public. In particular, it occurs to me that a naive reporting mechanism inherently reveals that the reported identity has associated with the reporting operator. I assume you've given this problem some thought - is there an obvious way around it? My concern would be that a more general use reputation system (ie one that goes beyond simple "illegal content" and "spam" event reports) would rapidly begin leaking association data on a broad scale, even from otherwise private communities. I guess the goals here are at odds in a fundamental way. A server should be able to report scores for it's participants. Querying an identity should reveal it's various scores. Now repeat spammers (or those posting illegal content, or who are just generally assholes, or whatever) can be filtered out. But in being able to query scores for an identity I don't see how you can avoid revealing the entity that reported any given score. If a broad set of categories are being reported (consider, for example, the birthday cake example from the article) then the information leakage seems like it would end up being quite broad.
- xoa 6y agoPerhaps rather then filtering per se, focus on the economic equation of moderation. Fundamentally moderation is about the time/resource cost of the moderator(s) vs the time/resource cost of evasion. Good moderation is probably an AI-complete problem, so it's hard to automate right now. Most efforts at improving that seem to either use broad brush measures and heuristics on the mod side, or so-so proxy measures for the evasion side. From captchas to money to asking for ID, all at the end of the day are about trying to make it more 'expensive' to evade bans. If the expense is really high, then even a small bit of moderation can keep up. But instead of any of that why not just do a time token directly and with full pseudonomyity? Matrix.org could ask people to do something like brute force RSA, choosing key lengths based on how much time they want to represent, and then sign a "Time Level" certificate result. Community operators could then dynamically adjust how much "time investment" they wanted to require in order to participate, and would have a mechanism to ban independent of IP or anything else. And this could be expected to increase over time as people let their systems run a day or two a month. If in a few years it requires a token equivalent to a month of computation time that would be a high bar to evasion. It would not require any money, identity, or knowledge of behavior elsewhere, but people would have strong incentives not to burn their Time Level tokens, or at least to comply with non-permanent bans. You could further tweak things by having per-community tokens which can only be issued once per cert, so identity can't be as easily tracked across communities while still stopping evasion. This should all be near completely automatable as well. Anyway, just some musing. I guess the question is if communities had effective cryptographicly guaranteed rate controls and moderation stickiness, would they really need more in practice to keep up?
- oh_sigh 6y agoI got hit by this with reddit and the masstagger. Normally, people aren't going to go through the post history of someone who says "look at these muffins I baked", and find they posted in an unsavory sub years ago. But with masstagger, anyone who posted in T_D got a big ol flare calling them out. But, the only reason I went there was to say "hey, you guys are stupid racists" to some posts. But the actual content of my posts weren't discussed, merely the fact that I filthied myself by even going near that sub. For Matrix, it would be like someone going onto a firearms room to talk about increasing gun control laws in the US, but then that means that all of the sudden your global reputation includes "firearms", and people on cooking topics will call you an asshole who supports murdering children, even if you are the most anti-firearms person in the world.