39 ms·
A clip from Stray got me banned from Twitter
- r0rshrk 4y agoI get this on visiting the linked website. What? > We've discontinued servicing users from your location and are thereby preventing access to any of the websites owned and operated by ZAM Network, LLC DBA Fanbyte (the owner of Fanbyte.com): This decision is ultimately one we were forced to make due to the number of visitors from your region when compared to the operational costs necessary to continue providing access there. It was a tough decision but one that we ultimately had to accept. This is an indefinite decision. We genuinely apologize for the inconvenience this will cause all of those who reside within your region.
- jhanschoo 4y agoIts clear that the broken element in this process is not the AI banning the writer of the post, but the poor presumably human review
- atemerev 4y agoGood human reviews are, well, nearly impossible at the scale of Twitter or Google. It would require employing hundreds of thousands of reviewers, training them, and paying them decent salaries for one of the most horrible jobs in the world. So, everybody is trying to automate as much as possible in this area. I am sure that in this case, if there is a human even involved in the escalation, it takes them a few seconds to decide on each case, with poor decision quality.
- crote 4y agoYour point being? If you are building a many-billion-dollar company on user-submitted content, moderation is pretty much a necessity. A hospital can't decide not to sterilize because it is "too difficult" either, can it? Especially when it comes to Google, which tries to entangle itself in every aspect of your life, being banned from all services without any potential for a proper review just because a neural network decided to throw a hissy fit is completely unacceptable.
- Kiro 4y agoFunny how you get downvoted for saying something everyone on HN agreed on when "Open Letter from Facebook Content Moderators" was published, with comments like "That is a simple problem for which Facebook should be able to apply existing technology. There is a lot Facebook can do, but they are not, because they are lazy.", calling for more automation and less traumatic moderation work.
- simoncion 4y agoI didn't agree on it. What likely happened was a bunch of excited folks wrote a whole bunch of words, and that volume gave the appearance of consensus. Automated review is not good enough for services that are so large that they are de facto public squares. If the world were just, when you got that big, the rules would change to prohibit you from doing service-wide content filtering. > ...calling for more automation and less traumatic moderation work. Pay me 80% of what I would be making as a programmer (and keep up with changes in the market rate for programmers), and I'd be totally willing to do that moderation work. [0] There are _tons_ of people who have my intestinal fortitude out there... problem is that the enormous "social media" companies don't want to pay enough to get people who are well-suited for the work. [0] You might counter with "Oh, well you can't _possibly_ imagine the things you'll see, you're all bluster and bravado and will quit within the month!". I'd counter with "Yeah, well you have no idea the things that I _have_ seen.".
- Wowfunhappy 4y agoIt's the year 2032, and Wings, Jack Dorsey's self-driving taxi service, is a hit. Because Wings doesn't have to pay human drivers, most of their rides are free. The company makes money by showing ads during rides and selling data about users's movement habits. Wings is not profitable yet, but revenue is through the roof, and the company is expected to IPO for a zillion dollars. Unfortunately, Wings's self-driving AI is much likely to destroy property than a human driver. As a result, some members of the public have called for every Wings car to be remotely controlled by a human. However, others push back. Employing good human drivers would be nearly impossible at the scale of Wings. Here is an interview with a poor grandmother who relies on Wings to see her family, and here's how a nonprofit uses Wings to find homes for lost puppies. You don't really don't want to go back to paid Uber and Lyft rides, do you? There are a couple of problems with this analogy. But the core point is this—if a company can't sustain a key aspect of their business at scale, then perhaps they shouldn't be able to scale.
- atemerev 4y agoThere is an equilibrium point beyond which mass protests and regulations pressure start. Every company is iterating and optimizing to find this equilibrium point, and then stays slightly behind it.
- Wowfunhappy 4y agoI happen to think today's social media companies are well past the equilibrium point.
- atemerev 4y agoWell, I don't see mass protests against Google and Facebook yet, so perhaps they are not. (I do see mass protests against Uber though).
- danaris 4y agoOh, so they'd have to spend a bunch of money to treat people like human beings? Boo fucking hoo. The money is the problem here. We should require them to spend that money, and if they can't remain profitable while employing sufficient human moderators to not be a net detriment to society, they should not be allowed to keep operating. We've gotten way too far down the rabbit hole of "any company that can conceivably exist must be allowed to exist, so long as they can make a profit." We really need to get back to companies having to provide some meaningful net benefit to society, rather than just making scads of money for their owners.
- atemerev 4y agoOK, press for regulation! So far, I haven’t seen any mass action that would be sufficient for the big tech to change their ways. People are mostly content with the status quo.
- spicyusername 4y agoI'm not so sure I agree. The typical argument for AI moderation in these situations is something along the lines of "Twitter is so big how could we possibly moderate at this scale without AI?" Does a company have a right to scale faster than it has the ability to properly moderate? Should they? Looking at a more extreme example: If General Motors used AI to design cars and they increased the likelihood of fatalities, would we feel any different?
- belltaco 4y ago>Does a company have a right to scale faster than it has the ability to properly moderate? A right? Yes. >Looking at a more extreme example: If General Motors used AI to design cars and they increased the likelihood of fatalities, would we feel any different? Getting (temporarily?) banned from Twitter isn't even close to being as bad as a fatality, so the GM example doesn't make any sense.
- czx4f4bd 4y agoAn AI arbitrarily banning someone for a completely innocuous post isn't broken?
- sascha_sl 4y agoIf the false positive rate is low and human review is swift and not broken, I really wouldn't mind. It's a force multiplier that every social media platform needs to not drown in costs for human moderation. Especially human moderation as described above. Unless you get people to pay for social media. Good luck with that.
- jhanschoo 4y ago> arbitrarily banning If that ban by AI is available for review and appeal, it's just triage that admits false positives. The alternatives that I can fathom is to either allow unsavory and potentially harmful content to be present on your platform until human eyes get on them, or to have all comments await moderation until human eyes get on them.
- tux3 4y agoHuman review is pretense, it costs more to do anything else. A human is told to process these as fast as possible, so the issue can be resolved. With these incentives, it wouldn't be reasonable to actually watch the videos in question. That's not what the system is designed to reward. The human is there to rubber stamp the AI decision as fast as possible, so that Twitter can tell you your case has been reviewed by a human and settled. The important metric is speed, because that directly translates into cost.
- tyingq 4y agoIt's telling that the AI doesn't just flag something, without banning it, and let a human do a proper review.
- petee 4y agoA few people commenting on the post say they to had a similar bans when clipping through the world and a grey screen was shown. Maybe the solid gray is triggering the AI to pick any policy violation that had gray in it once...
- khuzudin 4y agoOr, as suggested by another commenter, the AI is triggering off of the camera moving quickly downward while pointing upward, which is similar to upskirting videos.
- deleted 4y ago[deleted]
- spicyusername 4y agoIt seems like the problem with many of these tech companies (and many modern companies in general) is that they've scaled faster than they have the ability to operate properly. "How can we possibly moderate properly without AI?" is really just another way of saying "We don't want to pay the money it's going to cost to moderate effectively and we're going to cross our fingers that we can solve problems caused by technology with more technology." That failure to operate is causing harm but the kind of harm it causes is hard for the public or politicians to understand, so it goes on unaddressed.
- musingsole 4y agoI don't think it's even the money anymore. I think technologists are convinced they are ALMOST there with automoderation systems...just a few more data points and another thousand hyperparameters and it'll be perfect! I think they've yet learn to recognize the good because they're too busy dreaming of the perfect.
- vincvinc 4y agoI think this is a fair assessment. Big social media companies are not incentivized to care about psychological and social side effects of their product. A bit like cigarette companies offloading externalities onto society, but much harder to specifically identify and address.
- ISL 4y agoDo you think that Twitter could possibly survive as a company without large amounts of automated moderation?
- gambiting 4y agoIt couldn't, but what all of these companies could absolutely do is pair automated moderation with human review. When AI flags something as innapropriate, a human has to sign it off before it's removed or the account suspended. The only exception for it is when content matches a known hash for illegal content - then it should be removed automatically.
- Sakos 4y ago> But there’s also a larger thing here where Twitter apparently has moderation tools so powerful that they can immediately trigger bans for things other than what they’re actually looking for. The actual execution leaves a lot to be desired here, but the itchy trigger finger cannot be denied. Somehow they can do this, but racial slurs are generally pretty okay, white supremacy is largely ignored, and every Twitter troll I’ve reported for harassment gets a three-week investigation and then a “We find they did not violate our rules” email. This is one of the things that annoys me most about major sites like Twitter or YouTube. Inconsistent enforcement of rules and little to no avenue for appeal.
- noSyncCloud 4y agoSame thing on Reddit. You can basically advocate for genocide, completely unhindered, by calling entire classes of people "degenerate" (literal Nazi rhetoric), but get banned for calling it out.
- XorNot 4y agoDepends who bans you on Reddit - i.e. moderators on individual subreddits have leeway to make those places whatever they want them to be.
- Sakos 4y agoIt reminds me of zero tolerance of violence policies at school, where the victims would often be punished instead.
- zionic 4y agoMaybe 10 years ago this was true, but Reddit today is heavily censored at the admin level.
- gruez 4y ago>You can basically advocate for genocide, completely unhindered, by calling entire classes of people "degenerate" (literal Nazi rhetoric), Are you sure you're not reading too much into it? Without context it's really hard to tell whether a use of "degenerate" literally means you want to genocide some group.
- mkl95 4y ago> Overnight, I received a response that my appeal had been denied. So a human being, someone who works at Twitter dot com, looked at that video, looked back at the rule it was breaking, looked once again at the video, and went “Yeah, this all checks out.” My guess is that appeals are either processed by some simple code or offloaded to some cheap labour service - such as Amazon Mechanical Turkey or some sweatshop in a developing country.
- enraged_camel 4y agoIt’s Mechanical Turk. Although Mechanical Turkey sounds cooler. :)
- daneel_w 4y agoI would be surprised if every initial appeal isn't deflected by automation, as first step, just to fend off "annoying users" and get rid of those who don't care.
- Kukumber 4y agoWhat i find surprising is people willing to trust a random person saying they got banned without elements to prove it I find this very suspicious, why not show what twitter told you? that seems to be the first thing someone would share when they complain about getting banned I'll go with "trying to surf on the Stray hype to get clicks" until proper more details are shared
- deleted 4y ago[deleted]
- paulgb 4y agoI suppose it’s possible someone would make this up, but having dealt several times with erroneous content removal / account blocking from FANG companies, the story rings true. E.g. I’m currently banned from Google Ads because they “detected suspicious payments” without ever trying to charge my card (the same card I use without issue for GCP and Google Workspace). They’ve denied three appeals without any information and still won’t tell me how to fix it. I have a feeling I’ll have to write one of these blog posts to make anything happen.
- treesprite82 4y agoThe full video that supposedly causes the auto-ban is in the article, so I decided to just try it: https://i.imgur.com/WEP4dcV.png https://i.imgur.com/WEP4dcV.png I assume "additional tasks" means needing to delete the tweet to be unsuspended, as the author described.
- Kukumber 4y agoNow that's interesting
- deleted 4y ago[deleted]
- OrangeMonkey 4y agoThis is how big tech does damage to humans. Love it or hate it, the online world is our current public square. A public square, in the united states, has typically been an area where people can shout out their concerns or whatever they want to anyone who can listen and the government cannot stop it. Currently, our public squares are owned by private megacorporations that not only ban people for reasons many people agree with, but also for insane things like this. There is no appeal unless you convince enough others (using another public square) you are right and they also scream for you. Eventually, all of us that are 'ok' with this will end up being banned from one service or another for life, with no appeal, and thats that. A perfectly pristine public square filled not with people, but consumers staring at advertising boards. I would love to know a way this can be solved as its painting a depressing picture. I don't like how this makes me feel.
- FreeTrade 4y agoThese megacorporations answer that you're using a 'private platform' - the answer is to use a public platform. https://youtu.be/SkaaPcjKI2E https://youtu.be/SkaaPcjKI2E
- jwolfe 4y agoIt should be noted that this is self-promotion.
- bandyaboot 4y ago> I would love to know a way this can be solved as its painting a depressing picture. When a giant corporation says “here’s our private property, use it as your public square”, say “fuck off”.
- iasay 4y agoWorth pointing out that more life exists outside the corporate run stages. Part of their trick is to make you think that the only way of life is via their platforms. I’m not and never have been a Twitter or or TikTok or Facebook member.
- TekMol 4y agoEvery time I read about these dystopian deplatforming events on Hacker News, my first reaction is to write a comment on how we could find our way out of this. Then the term "Web3" comes up in my mind, and then I think "Oh now, this is HN, they will burn you alive" and I turn to other things again. But right now, for some reason I feel so strongly about, I'll give it another try. Wouldn't it be great if we could tackle two issues with in one go? The annoying interfaces of Twitter/FB/Insta and co and the constant fear of being deplatformed? By publishing our stuff on a decentralized database that is open for anyone to read in whatever way they like? I fight hard to read the web in my way. When I see a link to Twitter, I manually change it to Nitter. I use an ad blocker. Bookmarklets to remove sticke elements from the pages I visit. I try hard to publish my stuff, so it cannot be deplatformed easily. Preferably on my own domain. But it's all crutches. The web I read still feels aggressive, annoying, mean, dangerous, exhausting. The most important platforms I write to (where people can like and comment) give me the feeling of walking on thin ice. Every moment, me and my audience might be separated. I really long for a future where content is published in a freely available database. Free to read from and free to write to. Where a post is a content addressable piece of data signed by the author. And comment too. And where a like is a cryptographically signed message, "I like this /joe". And where the order of your "feed" is not adjusted by outside forces.
- matthew-wegner 4y agoWhy does it need to be "web3" and not "RSS"?
- TekMol 4y agoHow do you prevent someone from copying your RSS and making it their RSS? Where is the proof that you published it first? How do you show that you have many followers when you publish via RSS? How do you "like" something you read via RSS? How do you comment on it? How do you like and comment in a way that proves your identity? How do you prove to the world that your identity is important - aka that you have lots of followers and likes? These are the bits and pieces the digital social fabric is made of. Currently it is all owned by companies.
- gverrilla 4y agoOn the other hand, it`s probably good for your mental health that you got banned from Twitter. Idea: delete your account there.
- TrianguloY 4y agoCompanies play by the rule "better sorry than safe" but force their users to play by "better safe than sorry". As others have mentioned, they main issue is not the autobanning (it sure is a false positive, those things inevitable happens on mass-scale products) but the appeal rejection that fails to detect it.
- vintermann 4y agoBut they aren't sorry either. This guy appealed, and if a human at Twitter ever saw it, it was probably some overworked contractor who gets a strike for every appeal he lets through.
- TrianguloY 4y agoIf this gets enough traction they will be on a few days (or at least they will revert the ban). It's sad.
- nullc 4y agoYep-- if the appeal hit a human and got a quick "oops" sorry! that would be another matter entirely. I wonder if they're using their obviously invalid "appeals" results to train the AI? ... so as time goes on it just gets dumber and dumber.
- Alex3917 4y agoHow long until people start selling DRM technology that purposely prevents people from sharing clips of games on Twitter and Facebook by embedding adversarial GAN attacks to trick the AI into thinking that they contain illegal content.
- gs17 4y agoI couldn't see that having any demand from game companies. They generally want you to share gameplay footage so other people will see it and want to play too, even preventing spoilers isn't worth burning your customers like that. But I could see it getting demand from people who want to use it as a weapon.
- dane-pgp 4y agoA simpler technique which already exists is embedding invisible unique watermarks in the video output of the game, which can be revealed with image processing[0]. Of course that doesn't prevent the image being tweeted, but it does mean they can punish the person who made the tweet, which might be enough of a deterrent in most cases. [0] https://www.reddit.com/r/battlefield2042/comments/p319oj/if_youre_planning_on_being_one_of_those_who_leak/ https://www.reddit.com/r/battlefield2042/comments/p319oj/if_...
- weird-eye-issue 4y agoI'm in Thailand and just get this message: We've discontinued servicing users from your location and are thereby preventing access to any of the websites owned and operated by ZAM Network, LLC DBA Fanbyte (the owner of Fanbyte.com): This decision is ultimately one we were forced to make due to the number of visitors from your region when compared to the operational costs necessary to continue providing access there. It was a tough decision but one that we ultimately had to accept. This is an indefinite decision. We genuinely apologize for the inconvenience this will cause all of those who reside within your region. Note: This is not related to Russia/Ukraine or any other political/military actions around the world.
- lebed2045 4y agoCould you please elaborate? Twitter stopped working with particular ISP because of cost related problems?
- jefftk 4y agoThe host of this article has decided to stop providing service to Thailand. Maybe because of the cost of compliance with internet regulations there?
- weird-eye-issue 4y agoHard to elaborate since I've been blocked and can't see anything except for literally just that message
- toastal 4y agoWell at least it seems there are other folks to comiserate with you. I'm based in Thailand too and this isn't the first time the region blocked from content that seems like it should be benign like a new article.
- heystefan 4y agoI'm getting the same message from the OP's website, and I'm in eastern europe. Weird.
- jsheard 4y agoA couple of months ago it was discovered that posting this little guy https://i.imgur.com/Bzo3Vae.jpg https://i.imgur.com/Bzo3Vae.jpg on Twitter would instantly earn you a 12 hour suspension for doxxing. Fuzzy image matching works in mysterious ways. https://twitter.com/Raddagher/status/1533326201602707458 https://twitter.com/Raddagher/status/1533326201602707458
- nullc 4y agoThis is standard. Reddit's started doing it too recently. Totally random stuff, instabanned. Reddit threatened me with a suspension for threatening violence over a polite and entirely non-violent post. Meanwhile, I report actual revenge porn, and they reply that it doesn't violate their content guidelines. (and I mean completely unambiguous with a posters gloating about how it shows up when googling the victims name and that her classmates and future employers would see it) I went through months a while back trying to get twitter to remove an impersonator claiming to be me (and using my photographs, etc.) who's MO was to start conversations with friends/family/professional comments and begin cussing them out. Didn't want to do anything about it.
- vintermann 4y agoThere's a lot of perverse incentives, people aren't punished for being trigger happy. I remember in a subreddit, there was a discussion about Facebook "top posters". I replied it wasn't exactly news, and wrote about the "top posters" to the letters to the editor of a local newspaper in my childhood. One was a famous TV meteorologist who would always write rebuttals to young earth creationists, from a Christian perspective. One guy was leader of a tiny racist party who would write about how Yugoslav refugees would take over our country. Others still were just old cranks who had an opinion on everything. The guy who owned that subreddit banned me over "doxing". I tried arguing, hey, they were public figures in their day, writing under full names (and location!), and they're long dead now anyway, but he either didn't want to admit he was wrong or was just terrified of losing the subreddit to the admins.
- pid_0 4y ago[dead]
- sp332 4y ago@a2_4am got banned from Twitter for linking to a video on the Internet Archive. The video is of an Apple 2 computer booting up an old program. https://mobile.twitter.com/textfiles/status/1536378776094908422 https://mobile.twitter.com/textfiles/status/1536378776094908... He ended up fighting for days and the appeal was never granted, even after someone on that thread said they escalated internally. He ended up moving to Mastodon, @a2_4am@mastodon.social
- CameronNemo 4y agoThis is a good response. If twitter shows they don't care about you enough to make careful moderation decisions, then leave them with their shitty toys and dark patterns. Saves me a visit to nitter.net.
- q-big 4y agoConsider it as a lesson not to make yourself too dependent on the whims of big tech companies. Ideally, learn to set up your own infrastructure.
- tiborsaas 4y ago> So I appealed with my trademark good humor. Maybe it was not the right time to be concise and witty. You just can't know who reads it, which culture, where and what mood they are in.
- drhodes 4y agoCalling the support staff "dense" was probably not the right move..
- sneak 4y agoStop complaining about policies and implementation of censorship, and switch away from donating content to censorship platforms. This will continue so long as you donate content to a platform that feels entitled to decide what you are allowed to speak or read. Fuck that noise. Join us on the fediverse. @sneak@sneak.berlin
- znpy 4y ago«Turns out that maybe we shouldn't be letting AI handle moderation.» It's always the same... People speak up and things suddenly are a problem ("turns out that...") only when the bad thing has happened to them. If there's any actual point that we should take home is that bad consequences are going to happen, and we'd all better listen up when other people warn us about these things before it's too late. AI moderation is just one of the topics we are all generally ignoring.
- kiawe_fire 4y agoIn my circle of friends and family, I’ve been warning them every time I hear of someone unjustly banned somewhere that: (a) big tech has too much power (b) you should probably not rely too much on Facebook or Twitter for photos, groups, etc Without fail, I’m “just delusional” and “if someone was banned, it’s because they did something to deserve it”, _until_ they themselves get banned for something. The most frustrating part - one friend of mine who was banned for something he posted, appealed and was reinstated. When he was banned, “big tech has too much power”, but since _his_ appeal was successful, he’s already back to “anyone who’s banned deserved it”. I have yet to be banned myself for anything (a fact that my critics like to use as “proof”), but i recognize that if it can happen to someone posting a video game clip, it can happen to me.
- shmde 4y agohttps://web.archive.org/web/20220720163040/https://www.fanbyte.com/features/how-a-clip-from-stray-got-me-banned-from-twitter/ https://web.archive.org/web/20220720163040/https://www.fanby... The site is showing me that they cannot serve me because of the place I live.
- lizardactivist 4y agoAnd now Twitter, too, or perhaps this has been going on for a while. I thought it was just Google that were AI-banning people left and right with no recourse.
- sumanthvepa 4y agoOdd. The website fanbytes seems to blocking users from India. Surely a simple blog post must have fairly low bandwidth requirements. And a simple CDN should alleviate issues? Or do they just not like Indians?
- azureel 4y agoSame here, I am connecting from Turkey and we are also banned. We've discontinued servicing users from your location and are thereby preventing access to any of the websites owned and operated by ZAM Network, LLC DBA Fanbyte (the owner of Fanbyte.com): This decision is ultimately one we were forced to make due to the number of visitors from your region when compared to the operational costs necessary to continue providing access there. It was a tough decision but one that we ultimately had to accept. This is an indefinite decision. We genuinely apologize for the inconvenience this will cause all of those who reside within your region. Note: This is not related to Russia/Ukraine or any other political/military actions around the world. If you need to reach out to us, please use our support portal.
- ttpphd 4y agoThis is far from the main discussion, but I used to be a "stinker" like the author describes, and I have a touch of unsolicited advice. Life is much happier if you save your obstinate streak for very limited, important occasions. Otherwise, you live your life ensnared in the negativity of trivial violations of your personal expectations about values and behavior.
- saurik 4y agoAlternatively, we need people--nay... heroes--such as this, or bullies like Twitter get to run roughshod over everyone.
- ttpphd 4y agoObstinacy does not guarantee success. My advice is a variation of "pick your battles". It's ok to have battles, just don't make them a big enough part of your life that it becomes your personality, and don't engage without proper forethought.
- bambax 4y ago> Overnight, I received a response that my appeal had been denied. So a human being, someone who works at Twitter dot com, looked at that video, looked back at the rule it was breaking, looked once again at the video, and went “Yeah, this all checks out.” Of course not. "Appeals" are certainly not reviewed by human beings; maybe by another AI, or more probably by the same AI with higher thresholds. This is all automated stupidity. Twitter does have a "bot problem", except that the bots are inside, not outside.
- deleted 4y ago[deleted]
- lapcat 4y agoMy Twitter account has been suspended multiple times, the last time for an obvious joke. As with the article author here, Twitter reviewed my appeal and denied it. https://lapcatsoftware.com/articles/twitter4.html https://lapcatsoftware.com/articles/twitter4.html In the end I caved, giving Twitter my phone number and deleting the tweet, because I need my Twitter account for professional purposes. But now guess what, there was a data breach, and hackers are selling millions of Twitter user phone numbers and email addresses. https://restoreprivacy.com/twitter-vulnerability-exposes-5-million-accounts/ https://restoreprivacy.com/twitter-vulnerability-exposes-5-m...
- tzs 4y agoYour joking speculation that there may be a YouTube video on how to cut off your own leg was in fact correct. There is one from "the leg man" posted 4 years ago.
- vorticalbox 4y agoThis is why you do not use a work/professional account for things other than work.
- deleted 4y ago[deleted]
- lapcat 4y agoHow do you judge what's work and what's not work? For many people, such as the self-employed, their online presence is part of their brand, and Twitter is professional networking. This applies to both Craig and myself.
- vorticalbox 4y agoI would likily ask myself if this post is likily to effect my online presence and if the answer to that question is anything but a sound no then I wouldn't post it. That said my online presence isn't part of my professional life. So my opinion probably isn't worth much.
- jdesjean 4y agoWhy is the consequence account suspension? We know the value these accounts can have and that moderators do not always get it right. Unless, the user has a history of bad behavior, the consequence should be flagging and hiding the content before warning the user. LinkedIn is one of the social media with a more sensible policy by following the latter.
- lapcat 4y ago> Why is the consequence account suspension? Good question. It feels Orwellian that Twitter suspends you and makes you delete your own tweet, on first offense, instead of just auto-hiding that one tweet.
- lovelearning 4y agoI'm amused that this article ranting about bans is published on a site that itself bans people merely based on their location: > We've discontinued servicing users from your location and are thereby preventing access to any of the websites owned and operated by ZAM Network, LLC DBA Fanbyte (the owner of Fanbyte.com)
- unixbane 4y agoTwitter is an abysmal shithole of bad software engineering and bad webshit policy, which seems to be a requirement to be a website that serves public utility. I also so happened to rant about idiot moderation policies just 2 days ago: https://news.ycombinator.com/item?id=32174538 https://news.ycombinator.com/item?id=32174538 I can write this rant every day. Also, this is the first thing that comes to mind when hearing "AI moderation". What we are seeing here is just hype and clout around the new AI boom and so idiot managers and consumers are demanding it regardless of whether it will be well engineered and put into an eligible application.
- deleted 4y ago[deleted]
- tolmasky 4y agoIt seems AI is quickly becoming capable of automating the worst human systems, vs. offering amazing solutions to humanities. In this case, it seems AI has successfully mimicked the horrible bureaucratic systems, operated entirely by humans, that leave you feeling equally helpless (think the film “Brazil”), only these fancy technical systems are cheaper, maybe? I suppose it should be no surprise that when we tried to imitate humans we got as bad end results as when humans were running things.
- 12ian34 4y agoThe author got banned for "revenge porn". I guess it's their fault for putting another pussy up on Twitter.
- z9znz 4y agoI just don't believe that many of these large tech companies actually have a human as the first, second, or sometimes even third contact for these kinds of issues. But what I find especially offensive is how the execs of these companies make bank while lying about the service they provide. Yeah, the service may be "free", but of course it's not really free. So any suggestion that we should not complain about quality for a "free" service is invalid.
- jmyeet 4y agoHere's an example of where metrics go wrong and create bad incentives. What Twitter (and virtually everyone else, to be fair) are doing is optimizing for the number of issues taht are dealt with automatically by some ML system or whatever. This is a bad idea because it incentivizes false positives and the only recourse is kicking up a big enough stink on social media such that an actual human looks at it. Even "appeals" get automated in this universe. Here's what you should optimize for: the number of cases a human support person can deal with (per unit time). Appeals must be manually reviewed so will drop the cases/hour. This disincentivizes false positives. If you optimize for this kin dof system you will use automated systems to funnel cases to a human for review. I know of several people who have gotten suspended or banned off these platforms for completely stupid reasons that any human looking at it would recognize. I'm wary of bad regulation here and certainly don't think people have a "right" to be on Twitter (for eample) but I do believe people should have a right to human review for any ban and you should able to challenge that ban in court if you have to. There should be no "we can ban you for any reason" out. Twitter in particular is so bad that the usual avenue of getting something to an employee is met with limited success because this had become so rampant (ie necessary) that Twitter was internally cutting down on that. Lastly, any such ban should be segmented. Google is the biggest violator of this principle. You should never, for example, lose access to your Gmail because an automated system falsely detected a questionable photo you uploaded or another automated system decided your name wasn't "real" (the latter happened in the Google+ days).
- bencollier49 4y agoTo be honest this is where something like the GDPR does do important work. In this case, Twitter have formed an opinion about this user (which they may have shared more widely). It is important to be able to find out what that opinion is and have it corrected if it is in error.
- junon 4y agoMost likely not. This is most likely a machine learning model that has a confidence score of pornographic material etc. and has mis-scored this post high enough to initiate an automatic suspension. I doubt they use prior account activity as a metric.
- eckesicle 4y agoIt's interesting to read the comments here and the debate around whether social media counts as a public square or not. Ultimately, the web, and social media, is where a majority of our citizens spend a large chunk of their time. While it's certainly true, that you don't _need_ to access them to live your life, for the vast majority of us it would be more than an inconvenience to be banned. In all other aspects of our lives, we do not accept rules imposed upon us by a large private actor. There are courts, and appeals processes, and politicians, and other channels through which we can assert our societal norms. Not so with social media today. These societal rules and norms, are, and should be governed by a democratic process. Social media is undeniably now such a large and important part of our society and it's absurd that we do not collectively have control over the rules around it. Other infrastructure, like trains, were also originally private endeavours where your rights are now protected by the courts, and laws of the land. At some point, the interest of the collective takes precedence over the private rights of Zuckerberg and Dorsey. We are well past that point with social media. These private companies should be considered access points to the social graph, not owners of it, and therefore regulated as such.
- q-big 4y ago> These societal rules and norms, are, and should be governed by a democratic process. By deleting your account at services that show such a licentious behaviour, you can cast your democratic vote against such services. Not doing this or at least starting or joining a huge riot against such services as soon as you hear about such licentious behaviour means casting a democratic vote that what the big tech company is doing is all right.
- hackerhasid 4y ago> So a human being, someone who works at Twitter dot com, looked at that video, looked back at the rule it was breaking, looked once again at the video, and went “Yeah, this all checks out.” I am going to go out on a limb and assume that the people handling these appeals are expected to hit a certain number per day whether explicitly or not. And to paraphrase Charlie Munger, there's the incentive and this is the outcome. I imagine someone sitting at a screen showing a queue of hundreds of thousands of posts awaiting review. Maybe there's even a leaderboard showing which employee has reviewed the most this month. Why waste their time watching the video in its entirety? Easier to just deny the appeal and move on to the next.
- bryan0 4y ago> You cannot possibly be this dense. Who is the dense one here? You just insulted a person who has to look at a million of these, and had absolutely nothing to do with the misclassification, and then you’re surprised when they rejected your appeal. Remember there are actual people reading your words (at least for now)
- aendruk 4y ago“You” is Twitter
- SZJX 4y agoExactly. I can’t believe so many commentators here (and maybe the employee who reviewed the request, maybe not) missed this simple point and turn the heat on the author instead. A shame that English doesn’t distinguish between the singular and plural forms of “you” I guess?
- TheRealPomax 4y agoYeah, heaven forbid you follow you company's policies as outlined for the appeal process, better to power-trip because someone who was banned from the platform, the harshest punishment your company has, is fully-expectedly-vocal about being mistreated.
- saghm 4y agoIdk, this feels like a bit of a double standard. Either being mistreated justifies bad behavior, or it doesn't. If it justifies insulting a customer service rep who didn't personally ban you in the first place, then that rep upholding your ban due to being unnecessarily aggressive is justified too.
- rpdillon 4y agoTwitter moderators are acting in a professional capacity, representing Twitter. In my mind, there really is a (justifiable) double standard.
- ezoe 4y agoThis is what I don't get about those US based companies. They hired thousands of employees, why can't they have a few dozens of human employees who manually evaluate the appealing? That's a necessary cost of providing a commercial Web service.
- parasubvert 4y agoLooks like this may be an actual bug in their AI that thinks it is Cat torture. Someone else got banned too: https://twitter.com/elyuwu_/status/1550373074847113217 https://twitter.com/elyuwu_/status/1550373074847113217
- estebarb 4y agoOh is ridiculous because Twitter does nothing with accounts that only exist to perform harassment or hate speach.
- masswerk 4y agoWe are doomed. Well, more seriously speaking, there's a serious issue behind these anecdotes: with things like Content ID and automated moderation, I see no alternative to any platforms for user generated content with even the slightest of commercial interests gradually transitioning towards alternative outlets for corporate media. The problem being, I do not see an alternative. Clearly, there are vital economic incentives for these platforms to pacify those first, who are both the biggest threat to them (in terms of lawsuits) and the sole or major source of income. Clearly, big platforms like these can't be viably worked without any amount of moderation (as there are bad actors out there) and realistically also without at least some oversight of the IP situation. (The latter may change eventually, as soon as there is corporate IP exclusively on these platforms. Direct and indirect content filtering as by recommendation systems will eventually ensure this, with more and more professionalized user channels becoming alternative media corporations themselves.) Clearly, more conventional measures, like community efforts (or sanctioning by social convention), won't do as the world has become too divided for this and there is no guarantee that social norms will always conclude with the vital economic interests of the platform. For the big platforms, there seems to be no way around automation (which is also enforced by the EU), but this is also clearly dysfunctional. So, how do we get out of this mess? (Any proposals are welcome.)
- tamaharbor 4y agoTwitter banned me for calling Maxine Waters an “old hag”.
- NelsonMinar 4y agoI'm now 4 days into a ban from the 10% of the Internet hosted by Akamai because I ran a script that took screenshots of my Pinboard bookmarks (one at a time across many sites) for a couple of days. I cannot find any way to contact Akamai to ask to be re-enabled. I support stopping bad behavior online and I get that automated detection is hard. But there's gotta be a safety valve for when the systems go wrong.
- myrmidon 4y agoThe wording of his appeal sounds extremely unhelpful and needlessly personally insulting to me. I'd strongly advise not to ever communicate as if you were talking to the unfeeling corporation itself- because in reality, you are adressing a person that you need to solve your problem and calling them "impossibly dense" is just a bad move.
- mmaunder 4y agoInteresting that another commenter got a similar clip banned from same source that also ended in a middle grey blank screen. I have a feeling that the algorithm is using luma only without color information, and in the absence of contrast (blank middle grey) it trips the first check it comes across. Would be interesting to test.
- zimpenfish 4y agoSimilar but less stressful: had one of my photos marked as "porn" on Tumblr back when the ban first came in. It was a Premier Inn room, focused on the double bed with my rucksack on it. Utterly baffling. Thankfully they undid the warning when I appealed.
- efitz 4y agoFacebook has been using ML to detect “revenge porn” images since at least 2018. Likely they don’t know any more than you or intone else does why their ML classifies your image that way. In fact, one of my pet peeves about ML is that most of the time no one can meaningfully explain why it made any particular decision (they can explain inputs and weights and the algorithms used and matrix math, etc, but can’t say “the model was 93% sure that part of the image was a penis”). Anywhow if an actual human did look at your first appeal, you did not do yourself any favors calling them “dense”. People don’t like it when you call them stupid[1]. [1] https://www.theonion.com/people-dont-like-it-when-you-call-them-stupid-1819583684 https://www.theonion.com/people-dont-like-it-when-you-call-t...
- jrm4 4y agoYou're not wrong about the "dense" thing, but it sure highlights the need to keep examining and reexamining the relationship between services like Twitter and e.g. censorship, governance, and the First Amendment. Nobody's breaking the law here, nobody's being unreasonable, I think, but this isn't a great balance of power.
- dorkwood 4y agoAt least Twitter has an appeal process. My Instagram account was switched off without warning. If I try to log in on desktop, I get a message telling me to "confirm your information using the Instagram app to try to get back to your account". The problem is that if I try to log in to the app, all I get is a black screen. This happens on both Android and iPhone. There are some buttons on the Android version, but the interface is unresponsive. It's like I'm stuck in some sort of verification loop that I'm unable to close. When I tell people about this problem, they immediately act like I've done something wrong. "Is your app up to date? You probably need to update something", is the common refrain. I've tried all the online guides. All my software is up to date. All I want at this point is to delete my account. But I can't, since the deletion link takes me to a page that asks I log into the app to try to get back to my account.
- wswope 4y agoIf you’re unable to access your email notification settings related to the account you’re locked out of, and have received any non-transactional emails related to the account, you can email their legal team regarding a CANSPAM violation to get a real human on the case (or a payday if they choose not to respond). May not apply to your circumstances; just throwing it out as I’ve had it work before in a similar context.
- dorkwood 4y agoWow, thanks for this, but unfortunately I disabled all those emails in the past.
- account42 4y agoThen your best option is to move to EU (or other regions with adequate consumer protections) and send a Art. 17 GDPR request. That or try to get your local government to better advocate for you. Probably neither is a very realistic option for your but I'm glad that at least some places are starting to look out of tech users even if we still need a lot more.
- code_duck 4y agoI have been suspended from Twitter for very silly things that don’t match the rule they claim I violated - very neutral statements that they claimed were “wishing harm” or something. It makes me appreciate the actual human moderation of HN.
- colordrops 4y agoI've been banned twice on Twitter for sarcasm that was misread as encouraging violence. Appeals weren't event denied. They just never looked at them. Waited two weeks each time.
- potench 4y agoSucks when there are false positives but I am glad there are efforts to reduce the likelihood a human has to watch and flag a video that could be “revenge porn”. Plenty of threads on the lasting affects of exposure to this type of content on moderators. (for example here’s a HN thread on a Facebook content moderator’s resignation https://news.ycombinator.com/item?id=26819883 https://news.ycombinator.com/item?id=26819883) Seems like additional signals should play into a confidence score though: how new is your account, what content is your account viewing, etc.
- micimize 4y agoA. A human _was_ involved and B. His issue was resolved within 24 hours: https://twitter.com/imranzomg/status/1549914737781063680 https://twitter.com/imranzomg/status/1549914737781063680 Like, come on. I agree that the processes and moderation models could be better, especially at the appeals phase, but we don't see the other side of the battle twitter content moderation is fighting. Even if their doing a stellar job statistics-wise, we probably wouldn't know because PR wouldn't want a blog post about how a twitter hovers on the brink of becoming a cesspool. I'm less sympathetic when inhumane moderation policies ruin lives as we see a lot of with google properties (YT, gmail), but this instance is pretty far from such a case.
- jrm4 4y ago"We don't see the other side" is perhaps literally the biggest problem. I will have sympathy for this process when they choose to tell us how it all works, clearly and plainly. Otherwise, let the metaphorical rock-throwing continue.
- dapids 4y agoWhat are you arguing here? That twitter is good at moderation because we simply can't see it behind the scenes? I can think of hundred different ways this could have affected someone negatively, especially if they weren't able to speak with support in native language. So c'mon, there is no excuse for this ban to take place, and then continue to be banned after the first appeal, statistics or not.
- micimize 4y agoMy primary points are that 24h turn around to get the issue resolved is not bad, and that blaming the AI is silly when the human in the loop didn't fix anything. But yes, I am also saying we don't know the reality of what the content moderation team is dealing with, we basically only see the false positives. I'm not saying they're doing a good job (especially the team handling appeals), I'm saying that we should be more sympathetic to the trade-offs involved in automated moderation.
- 4y ago
- TameAntelope 4y ago> Here’s the thing: I’m a stinker. Even at my jolliest, if someone figuratively shoulder-checks me, I’m probably going to make so many mountains out of this molehill that I will adjust the topography of the United States significantly. I’m sorry, but this is your real problem, not Twitter banning you. This is called “pride” and is historically recognized as one of the largest “problem creators” as far as emotions go. The author writes like this is some kind of noble trait, but is in reality very probably the source of many of the author’s negative experiences. There is a clear path to getting unbanned from Twitter, but the author refuses to take it. Shame.
- teawrecks 4y agoWhat is the clear path?
- snoopy_telex 4y agoAdmitting that the tweet is revenge porn by closing the review request and deleting the tweet. I mean, in this case, I’d likely keep forcing the review too. This is clearly just a bad detection
- vorticalbox 4y agoWill this not cause more issues? They will very likely use these appeals to help train the content AI. You're rewardimg it for a wrong decision that it will use for future decisions.
- zdragnar 4y agoThat's literally admitting to a crime. Even if the crime didn't actually happen, the tweet is gone, so now he's left with having admitted to a crime and no evidence to show that he didn't actually commit it.
- pvg 4y agoIt's not literally admitting to a crime. If I said that if you reply to this comment, you stole my wallet and you reply, you're not admitting you stole my wallet.
- js2 4y agoGeorge Orwell's 1984? Aldous Huxley's Brave New World? Nah, we're headed toward Terry Gilliam's Brazil: "Mistake? Haha. We don't make mistakes." https://youtu.be/wzFmPFLIH5s https://youtu.be/wzFmPFLIH5s (Or maybe Mike Judge's Idiocracy, but I'd wager Brazil.)
- deleted 4y ago[deleted]
- bencollier49 4y agoI've always thought that was the most plausible of the dystopias, and it's the most terrifying, because there's literally no way of avoiding becoming a target of the state (or whoever it might be assuming state-like functions).
- t0bia_s 4y agoLet's face it. Amount of recorded game content saved on servers is enormous. Value of this content do not cover costs of saving them. So... Agressive "rules" and algorithms for baning could be just excuses for obtaining space for saving more valuable content.
- rekrsiv 4y agoIn short: An automated process made a mistake and a customer made it worse by being mean.
- tablespoon 4y ago> It’s a prime example of maybe how we shouldn’t be letting AI run the world maybe, but this was clearly a mistake. So I appealed with my trademark good humor. > Overnight, I received a response that my appeal had been denied. So a human being, someone who works at Twitter dot com, looked at that video, looked back at the rule it was breaking, looked once again at the video, and went “Yeah, this all checks out.” The most cost-effective an efficient implementation of an automated appeals process is the UNIX command "yes no". I'm convinced it's also in widespread use.
- LAC-Tech 4y agoBeing banned from Twitter may end up being a blessing in disguise. I don't think open air micro-blogging brings out the best in people.
- TradingPlaces 4y agoMaybe it would have been easier to get his account back if he had left off “You cannot possibly be this dense” when making demands on the free service he uses at the pleasure of the company that owns it. Civility costs you nothing. Snark gets you nowhere.
- feymese 4y agooh, looks like this site (fanbyte) bans people by their geolocation. ironic. (this is Türkiye at my case.) > We've discontinued servicing users from your location and are thereby preventing access to any of the websites owned and operated by ZAM Network, LLC DBA Fanbyte (the owner of Fanbyte.com): This decision is ultimately one we were forced to make due to the number of visitors from your region when compared to the operational costs necessary to continue providing access there. It was a tough decision but one that we ultimately had to accept. This is an indefinite decision. We genuinely apologize for the inconvenience this will cause all of those who reside within your region. Note: This is not related to Russia/Ukraine or any other political/military actions around the world. If you need to reach out to us, please use our support portal.