5 ms·
Everyone who memes long enough on the internet knows there's a meme about setting places / homes / etc on fire when talking about spiders right? So, I was on F
by giancarlostoro 3y ago
Everyone who memes long enough on the internet knows there's a meme about setting places / homes / etc on fire when talking about spiders right?
So, I was on Facebook a year ago, I saw a video, this little girl had a spider much larger than her hand, so I wrote a comment I remember verbatim only because of what happened next:
"Girl, get away from that thing, we gotta set the house on fire!"
I posted my comment, but didn't see it, a second later, Facebook told me that my comment was flagged, I thought that was too quickly for a report, so assumed AI, so I hit appeal, hoping for a human, they denied my appeal rather quickly (about 15 minutes) so I can only assume someone read it, DIDNT EVEN WATCH THE VIDEO, didn't even realize it was a joke.
I flat out stopped using Facebook, I had apps I was admin of for work at the time, so risking an account ban is not a fun conversation to have with your boss. Mind you, I've probably generated revenue for Facebook, I've clicked on their insanely targetted ads and actually purchased things, but now I refuse to use it flat out because the AI machine wants to punish me for posting meme comments.
Sidebar: remember the words Trust and Safety, they're recycled by every major tech company / social media company/ It is how they unilaterally decide what can be done across so many websites in one swoop.
Edit:
Adding Trust and Safety Link: https://dtspartnership.org/ https://dtspartnership.org/
- reactordev 3y agoThis is the issue, bots/AI can’t comprehend sarcasm, jokes, or otherwise human behaviors. Facebook doesn’t have human reviewers.
- Solvency 3y agoNot true. At all. ChatGPT could (and does already contain) training data on internet memes and you can prompt it to consider memes, sarcasm, inside jokes, etc. Literally ask it now with examples and it'll work. "It seems like those comments might be exaggerated or joking responses to the presence of a spider. Arson is not a reasonable solution for dealing with a spider in your house. Most likely, people are making light of the situation."
- mega_dean 3y ago> you can prompt it to consider memes, sarcasm, inside jokes, etc. I use Custom Instructions that specifically ask for "accurate and helpful answers": "Please call me "Dave" and talk in the style of Hal from 2000: A Space Odyssey. When I say "Hal", I am referring to ChatGPT. I would still like accurate and helpful answers, so don't be evil like Hal from the movie, just talk in the same style." I just started a conversation to test if it needed to be explicitly told to consider humor, or if it would realize that I was joking: You: Open the pod bay doors please, Hal. ChatGPT: I'm sorry, Dave. I'm afraid I can't do that.
- reactordev 3y agoYou may find that humorous but it's not humor. It's playing the role you said it should. According to the script, "I'm sorry, Dave. I'm afraid I can't do that." is said by HAL more than any other line HAL says.
- barbazoo 3y agoHow about the "next" meme, one it hasn't been trained on?
- esafak 3y agoIt won't do worse than the humans that Facebook hires to review cases. Humans miss jokes too.
- reactordev 3y agothis is a very poignant argument as well. As we strive for 100% accuracy, are we even that accurate? Can we just strive for more accurate than "Bob"?
- vidarh 3y agoI was disappointed that ChatGPT didn't catch the, presumably unintended, funny bit it introduced in its explanation, though: "people are making light of the situation" in an explanation about arson. I asked it more and more leading questions and I had to explicitly point to the word "light" to make it catch it.
- fragmede 3y agoChatGPT-4 isn't your father's bot. It is able to deduce that the comment made is an attempt at humor, and even helpfully explains the joke. This kills the joke, unfortunately, but it shows a modern AI wouldn't have moderated the comment away. https://chat.openai.com/share/7d883836-ca9c-4c04-83fd-356d4ab70c98 https://chat.openai.com/share/7d883836-ca9c-4c04-83fd-356d4a...
- tmoravec 3y agoHaving ChatGPT-4 moderate Facebook would probably be even more expensive than having humans review everything.
- esafak 3y agoThey're Facebook; they have their own LLMs. This is definitely a great first line of review. Then they can manually scrutinize the edge cases.
- ForkMeOnTinder 3y agoHow? I thought we all agreed AI was cheaper than humans (accuracy notwithstanding), otherwise why would everyone be afraid AI is going to take their jobs?
- dragonwriter 3y agoUsing Llama Guard as a first pass screen and then passing on material needing more comprehensive review to a more capable model (or human reviewer, or a mix) seems more likely ti be useful and efficient than using a heavyweight model as the primary moderation tool.
- fragmede 3y agoMore expensive in what? The GPUs to run them on are certainly exorbitantly expensive in dollars, but ChatGPT-4 viewing CSAM and violent depraved videos doesn't get tired or need to go to therapy. It's not a human that's going to lose their shit because they watched a person hit a kitten with a hammer for fun in order to moderate it away, so in terms of human cost, it seems quite cheap!
- School-Cotton 3y agoWhy do people who have not tried modern AI like GPT4 keep making up things it "can't do" ?
- barbazoo 3y ago> Why do people who have not tried modern AI like GPT4 keep making up things it "can't do" ? How do you know they have "not tried modern AI like GPT4"?
- esafak 3y agoBecause they would know GPT4 is capable of getting the joke.
- reactordev 3y agoI was talking about FB moderation AI, not GPT4. There are a couple AI LLM's that can recall jokes and match sentiment, context, "joke" and come to the conclusion it's a joke. Facebook's moderation AI isn't that sophisticated (yet).
- soulofmischief 3y agoIt's an epidemic, and when you suggest they try GPT-4, most flat-out refuse, having already made up their minds. It's like people have completely forgotten the concept of technological progression, which by the way is happening at a blistering pace.
- reactordev 3y agoI disagree with this view. I think most people who are interested, have tried it. They tried it with a variety of prompts. They found it novel but not entirely accurate. So while I do think there are some people who refuse to use AI at all, I’d love to point out that they already are. GPT on the other hand, is next level. There’s a level after that even. The point I was articulating is that the current gen bot/AI moderation models are not GPT level. At least today from my own experience in dealing with moderation and content flagging trolls. I do believe FB/Meta is fervently working on this with their models they are publishing in competition to GPT. So before you go burning down the town - Accept that technological advancement is great, when it solves your problem. Otherwise it’s bells and whistles to these people.
- NoMoreNicksLeft 3y agoSome day in the far future, or soon, we will all be humorless sterile worker drones, busily working away in our giant human termite towers of steel and glass. Humanity perfected. Until that time, be especially weary of making such joke attempts on Amazon-affiliated platforms, or you could have an even more uncomfortable conversation with your wife about how it's now impossible for your household to procure toilet paper. Fear not though. A glorious new world awaits us.
- comboy 3y ago> we gotta set the house on fire Context doesn't matter, they can't afford this being on the platform and being interpreted with different context. I think flagging it is understandable given their scale (I still wouldn't use them, but that's a different story).
- slantedview 3y agoHave you seen political facebook? It's a trainwreck of content meant to incite violence, and is perfectly allowed so long as it only targets some people (ex: minorities, certain foreigners) and not others. The idea that Facebook is playing it safe with their content moderation is nonsense. They are a political actor the same as any large company, and they make decisions accordingly.
- dumpsterlid 3y ago[dead]
- comboy 3y agoI have not, I'm not using it at all, so yes that context may put parent comment in a different light, but still I'd say the issue would be comments that you mention not being moderated rather than the earlier one being moderated.
- giancarlostoro 3y agoI think this is how they saw my comment, but the human who reviewed it was clearly not doing their job properly.
- H4ZB7 3y ago[flagged]
- pixelbyindex 3y ago> Context doesn't matter, they can't afford this being on the platform and being interpreted with different context I have to disagree. The idea that allowing human interaction to proceed as it would without policing presents a threat to their business or our culture is not something I have seen strong enough argument for. Allowing flagging / reporting by the users themselves is a better path to content control. IMO the more we train ourselves that context doesn't matter, the more we will pretend that human beings are just incapable of humor, everything is offensive, and trying to understand others before judging their words is just impossible, so let the AI handle it.
- deleted 3y ago[deleted]
- dwighttk 3y ago>can only assume someone read it, DIDNT EVEN WATCH THE VIDEO, You are picturing Facebook employing enough people that they can investigate each flag personally for 15 minutes before making a decision? Nearly every person you know would have to work for Facebook.
- ForkMeOnTinder 3y agoIt wouldn't take 15 minutes to investigate. That's just how long the auto_deny_appeal task took to work its way through some overloaded job queue.
- Ambroos 3y agoI worked on Facebook copyright claims etc for two years, which uses the same systems as the reports and support cases at FB. I can't say it's the case for OPs case specifically, but I absolutely saw code that automatically closed tickets in a specific queue after a random(15-75) minutes to avoid being consistent with the close time so it wouldn't look too suspicious or automated to users.
- sroussey 3y agoThis “random” timing is even required when shutting down child porn for similar reasons. The Microsoft SDK for their mandated by congress service explicitly says so.
- black_puppydog 3y ago100% unsurprising, and yet 100% scandalous.
- coldtea 3y ago>It wouldn't take 15 minutes to investigate. If they actually took the effort to investigate as needed? It would take them even more. Expecting them to actually sit and watch the video and understand meme/joke talk (or take you at face value when you say it's fine)? That's, like, crazy talk. Whatever size the team is, they have millions of flagged messages to go through every day, and hundreds of thousands of appeals. If most of that wasn't automated or done as quickly and summarily as possible, they'd never do it.
- flippy_flops 3y agoI was harassed for asking a "stupid" question on the security Stack Exchange, so I flagged the comment as abuse. Guess who the moderator was. I'll probably regret saying this, but I'd prefer an AI moderator over a human.
- tines 3y agoThere are problems with human moderators. There are so many more problems with AI moderators.
- gardenhedge 3y agoDisagree. Human mods are normally power mad losers
- bluescrn 3y agoIt won't be long before AI moderators are a thing, and censoring wrongthink/dissent 24/7, far faster than a team of human moderators.
- dkjaudyeqooe 3y agoAnd at the same time I'm reading articles [1] about how FB is unable to control the spread of pedophile groups on their service and in fact their recommendation system actually promotes them. [1] https://www.wsj.com/tech/meta-facebook-instagram-pedophiles-enforcement-struggles-dceb3548 https://www.wsj.com/tech/meta-facebook-instagram-pedophiles-...
- giancarlostoro 3y agoThey're not the only platform with pedophile problems, and they're no the only one that handles it poorly.
- skrebbel 3y agoIn defense of the Facebook moderation people, they got the worst job in the world
- zoogeny 3y ago> Everyone who memes long enough on the internet knows there's a meme about [...] As a counterpoint, I was working at a company and one of the guys made a joke in the vein of "I hope you get cancer". The majority of the people on the Zoom call were pretty shocked. The guy asked "don't you all know that ironic joke?" and I had to remind him that not everyone grew up on 4chan. I think the problem, in general, with ironically offensive behavior (and other forms of extreme sarcasm) is that not everyone has been memeing long enough to know. Another longer anecdote happened while I was travelling. A young woman pulled me aside and asked me to stick close to her. Another guy we were travelling with had been making some dark jokes, mostly like dead-baby shock humor stuff. She told me specifically about some off-color joke he made about dead prostitutes in the trunk of his car. I mean, it was typical edge-lord dark humor kind of stuff, pretty tame like you might see on reddit. But it really put her off, especially since we were a small group in a remote area of Eastern Europe. She said she believed he was probably harmless but that she just wanted someone else around paying attention and looking out for her just in case. There is a truth that people must calibrate their humor to their surroundings. An appropriate joke on 4chan is not always an appropriate joke in the workplace. An appropriate joke on reddit may not be appropriate while chatting up girls in a remote hostel. And certain jokes are probably not appropriate on Facebook.
- giancarlostoro 3y agoFully agreed, Facebook used to be fine for those jokes, only your relatives would scratch their heads, but nobody cared. Of course, there are way worse jokes one could make on 4chan.
- zoogeny 3y agoYour point about "worse jokes [...] on 4chan" is important. Wishing cancer onto someone is almost embarrassingly mild on 4chan. The idea that someone would take offence to that ancient insult is laughable. Outside of 4chan and without that context, it is actually a pretty harsh thing to say. And even if I personally see and understand the humor, I would definitely disallow that kind of language in any workplace I managed. I'm just pointing out that Facebook is setting the limits of its platform. You suggest that if a human saw your joke, they would recognize it as such and allow it. Perhaps they wouldn't. Just because something is meant as a joke doesn't mean it is appropriate to the circumstances. There are things that are said clearly in jest that are inappropriate not merely because they are misunderstood.
- WendyTheWillow 3y agoWhy react so strongly, though? Is being “flagged” some kind of scarlet letter on Facebook (idk I don’t really use it much anymore). Are the meaningful consequences to being flagged?
- giancarlostoro 3y agoI could eventually be banned on the platform for otherwise innocent comments. Which would compromise my account which had admin access to my employers Facebook App. It would be a Pandora's box of embarrassment on me I'd much rather avoid.
- WendyTheWillow 3y agoOh, but nothing would happen as a result of this comment specifically? Okay, that makes sense.
- donatj 3y agoInterestingly enough, I had a very similar interaction with Facebook about a month ago. An articles headline was worded such that it sounded like there was a "single person" causing ALL traffic jams. People were making jokes about it in the comments. I made a joke "We should find that dude and rough him up". Near instant notice of "incitement of violence". Appealed, and within 15 minutes my appeal was rejected. Any human having looking at that more than half a second would have understood the context, and that it was not an incitement of violence because that person didn't really exist.
- ethbr1 3y ago> An articles headline was worded such that it sounded like there was a "single person" causing ALL traffic jams. Florida Man?
- giancarlostoro 3y agoHeh! Yeah, I assume if it happened to me once, it's going to happen to others for years to come.
- Pxtl 3y ago"AI". Uh, I'm betting rules like that are a simple regex. Like, I was explaining how some bad idea would basically make you kill yourself on Twitter (pre-Musk) and it detected the "kill yourself" phrase and instantly demanded I retract the statement and gave me a week-long mute. However, understanding how they have to be over-cautious about phrases like this for some very good reasons, my reaction was not outrage but lesson learned. These sites rely on swarms of 3rd-world underpaid people to do moderation, and that job is difficult and traumatizing. It involves wading through the worst, vilest, most disgusting content on the internet. For websites that we use for free. Intrinsically anything they can do to automate is sadly necessary. Honestly, I strongly disagree with Musk on a lot, but I think his idea that new Twitter accounts cost a nominal fee to register is a good one just so that it makes accounts not disposable and getting banned has some minimal cost, just so that moderation isn't dealing with such an extremely asymmetrical war.
- aaroninsf 3y agoThere are so many stronger, better, more urgent reasons, to never use Facebook or participate in the Meta ecosystem at all. But every little helps, Barliman.
- giancarlostoro 3y agoI mean, I was already BARELY using it, but this just made it so I wont comment on anything, which means I'm going on there way less. There's literally a meme scene on Facebook, and they're going to kill it.
- _w1tm 3y ago> There's literally a meme scene on Facebook, and they're going to kill it. Oh no! Anyway
- didibus 3y ago> I flat out stopped using Facebook That's all you gotta do. People are complaining, and sure, you could put some regulation in place, but that struggles to be enforced very often, also struggles with dealing with nuances, etc. These platforms are not the only ways you can stay in touch and communicate. But they must adopt whatever approach to moderation they feel keeps their user base coming back, engaged, doesn't cause them PR issues, and continues to attract advertisers, or appeal to certain loud groups that could cause them trouble. Hence the formation of these theatrical "ethics" board and "responsible" taglines. But it's just business at the end of the day.
- ycombinatrix 3y agoi had a very similar experience more than 10 years ago. never got over it.