3 ms·
ChatGPT-4 isn't your father's bot. It is able to deduce that the comment made is an attempt at humor, and even helpfully explains the joke. This kills the joke,
by fragmede 3y ago
ChatGPT-4 isn't your father's bot. It is able to deduce that the comment made is an attempt at humor, and even helpfully explains the joke. This kills the joke, unfortunately, but it shows a modern AI wouldn't have moderated the comment away.
https://chat.openai.com/share/7d883836-ca9c-4c04-83fd-356d4ab70c98 https://chat.openai.com/share/7d883836-ca9c-4c04-83fd-356d4a...
- tmoravec 3y agoHaving ChatGPT-4 moderate Facebook would probably be even more expensive than having humans review everything.
- esafak 3y agoThey're Facebook; they have their own LLMs. This is definitely a great first line of review. Then they can manually scrutinize the edge cases.
- ForkMeOnTinder 3y agoHow? I thought we all agreed AI was cheaper than humans (accuracy notwithstanding), otherwise why would everyone be afraid AI is going to take their jobs?
- dragonwriter 3y agoUsing Llama Guard as a first pass screen and then passing on material needing more comprehensive review to a more capable model (or human reviewer, or a mix) seems more likely ti be useful and efficient than using a heavyweight model as the primary moderation tool.
- fragmede 3y agoMore expensive in what? The GPUs to run them on are certainly exorbitantly expensive in dollars, but ChatGPT-4 viewing CSAM and violent depraved videos doesn't get tired or need to go to therapy. It's not a human that's going to lose their shit because they watched a person hit a kitten with a hammer for fun in order to moderate it away, so in terms of human cost, it seems quite cheap!
- consp 3y agoOr, maybe, just maybe, it had input from pages explaining memes. I refuse to attribute this to actual sarcasm when it can be explained by something simple.
- fragmede 3y agoWhether it's in the training set, or ChatGPT "knows" what sarcasm is, the point is it would have detected GP's attempt at humor and wouldn't have moderated that comment away.
- barbazoo 3y agoOnly if it happened to be trained on a dataset that included enough references/explanations of the meme. It won't be able to understand the next meme I probably, we'll see.
- orly01 3y agoBut the moderator AI does not need to understand the meme. Ideally, it should only care about texts violating the law. I don't think you need to improve that much current LLM so they can detect actual harm threats or hate speech from any other type of communication. And I think those should be the only sort of banned speech. And if facebook wants to impose additional censorship rules, then it should at least clearly list them, and make the moderator AI explain what are the violated rules, and give the possibility to appeal in case it is doing wrong. Any other type of bot moderation should be unacceptable.
- reactordev 3y agoI normally would agree with you but there are cases where what was spoken and its meaning are disjointed. Example: Picture of a plate of cookies. Obese person: “I would kill for that right now”. Comment flagged. Obviously the person was being sarcastic but if you just took the words at face value, it’s the most negative sentiment score you could probably have. To kill something. Moderation bots do a good job of detecting the comment but a pretty poor job of detecting its meaning. At least current moderation models. Only Meta knows what’s cooking in the oven to tackle it. I’m sure they are working on it with their models. I would like a more robust appeal process. Like bot flags, you appeal, appeal bot runs it through a more thorough model, upholds the flag, you appeal, a human or “more advanced AI” would then really detect whether it’s a joke sentiment, sarcasm, or you have a history of violent posts and it was justified.
- fragmede 3y agoIt claims April 2023 is its knowledge cut off date, so any meme since then should be new to it. I submitted a meme from November and asked it to explain it and it seems to be able to explain it. Unfortunately chat links with images aren't supported yet, so the image: https://imgur.com/a/py4mobq https://imgur.com/a/py4mobq the response: The humor in the image arises from the exaggerated number of minutes (1,300,000) spent listening to “that one blonde lady,” which is an indirect and humorous way of referring to a specific artist without naming them. It plays on the annual Spotify Wrapped feature, which tells users their most-listened-to artists and songs. The exaggeration and the vague description add to the comedic effect. and I grabbed the meme from: https://later.com/blog/trending-memes/ https://later.com/blog/trending-memes/ Using the human word "understanding" is liable to set some people off, so I won't claim that ChatGPT-4 understands humor, but it does seem possible that it will be able to explain what the next meme is, though I'd want some human review before it pulls a Tay on us.