3 ms·

Only if it happened to be trained on a dataset that included enough references/explanations of the meme. It won't be able to understand the next meme I probably

Only if it happened to be trained on a dataset that included enough references/explanations of the meme. It won't be able to understand the next meme I probably, we'll see.

orly01 3y ago
But the moderator AI does not need to understand the meme. Ideally, it should only care about texts violating the law. I don't think you need to improve that much current LLM so they can detect actual harm threats or hate speech from any other type of communication. And I think those should be the only sort of banned speech. And if facebook wants to impose additional censorship rules, then it should at least clearly list them, and make the moderator AI explain what are the violated rules, and give the possibility to appeal in case it is doing wrong. Any other type of bot moderation should be unacceptable.
- reactordev 3y ago
  I normally would agree with you but there are cases where what was spoken and its meaning are disjointed. Example: Picture of a plate of cookies. Obese person: “I would kill for that right now”. Comment flagged. Obviously the person was being sarcastic but if you just took the words at face value, it’s the most negative sentiment score you could probably have. To kill something. Moderation bots do a good job of detecting the comment but a pretty poor job of detecting its meaning. At least current moderation models. Only Meta knows what’s cooking in the oven to tackle it. I’m sure they are working on it with their models. I would like a more robust appeal process. Like bot flags, you appeal, appeal bot runs it through a more thorough model, upholds the flag, you appeal, a human or “more advanced AI” would then really detect whether it’s a joke sentiment, sarcasm, or you have a history of violent posts and it was justified.
fragmede 3y ago
It claims April 2023 is its knowledge cut off date, so any meme since then should be new to it. I submitted a meme from November and asked it to explain it and it seems to be able to explain it. Unfortunately chat links with images aren't supported yet, so the image: https://imgur.com/a/py4mobq https://imgur.com/a/py4mobq the response: The humor in the image arises from the exaggerated number of minutes (1,300,000) spent listening to “that one blonde lady,” which is an indirect and humorous way of referring to a specific artist without naming them. It plays on the annual Spotify Wrapped feature, which tells users their most-listened-to artists and songs. The exaggeration and the vague description add to the comedic effect. and I grabbed the meme from: https://later.com/blog/trending-memes/ https://later.com/blog/trending-memes/ Using the human word "understanding" is liable to set some people off, so I won't claim that ChatGPT-4 understands humor, but it does seem possible that it will be able to explain what the next meme is, though I'd want some human review before it pulls a Tay on us.
- MikeAmelung 3y ago
  https://knowyourmeme.com/memes/you-spent-525600-minutes-this-year https://knowyourmeme.com/memes/you-spent-525600-minutes-this... was last updated December 1, 2022 and I'm in a bad mood now seeing how unfunny most of those are
  - fragmede 3y ago
    none of those are "that one blonde lady" here's the next one from that list: https://imgur.com/a/h0BrF74 https://imgur.com/a/h0BrF74 the response: The humor stems from the contrast between the caption and the person’s expression. The caption “Me after being asked to ‘throw together’ more content” is juxtaposed with the person’s tired and somewhat defeated look, suggesting reluctance or exhaustion with the task, which many can relate to. It’s funny because it captures a common feeling of frustration or resignation in a relatable way. Interestingly, when asked who that was, it couldn't tell me.
    - jstarfish 3y ago
      Now do "submissive and breedable."
    - MikeAmelung 3y ago
      I was just pointing out that meme style predates April 2023... I would be curious to see if it can explain why Dat Boi is funny though.
- dragonwriter 3y ago
  > Using the human word "understanding" “human word” as opposed to what other kind of word?
  - fragmede 3y ago
    "processing" is something people are more comfortable as a description of what computers do, as it sounds more rote and mechanical. Saying the LLM "understands" leads to an uninteresting rehash of a philosophical debate on what it means to understand things, and whether or not an LLM can understand things. I don't think we have the language to properly describe what LLMs can and cannot do, and our words that we use to describe human intelligence; thinking, reasoning, grokking, understanding; they fall short on describing this new thing that's come into being. So in saying human words, I'm saying understanding is something we ascribe to a human, not that there are words that aren't from humans.

Only if it happened to be trained on a dataset that included enough references/explanations of the meme. It won't be able to understand the next meme I probably, we'll see.

orly01 3y ago

But the moderator AI does not need to understand the meme. Ideally, it should only care about texts violating the law. I don't think you need to improve that much current LLM so they can detect actual harm threats or hate speech from any other type of communication. And I think those should be the only sort of banned speech. And if facebook wants to impose additional censorship rules, then it should at least clearly list them, and make the moderator AI explain what are the violated rules, and give the possibility to appeal in case it is doing wrong. Any other type of bot moderation should be unacceptable.

reactordev 3y ago
I normally would agree with you but there are cases where what was spoken and its meaning are disjointed. Example: Picture of a plate of cookies. Obese person: “I would kill for that right now”. Comment flagged. Obviously the person was being sarcastic but if you just took the words at face value, it’s the most negative sentiment score you could probably have. To kill something. Moderation bots do a good job of detecting the comment but a pretty poor job of detecting its meaning. At least current moderation models. Only Meta knows what’s cooking in the oven to tackle it. I’m sure they are working on it with their models. I would like a more robust appeal process. Like bot flags, you appeal, appeal bot runs it through a more thorough model, upholds the flag, you appeal, a human or “more advanced AI” would then really detect whether it’s a joke sentiment, sarcasm, or you have a history of violent posts and it was justified.

fragmede 3y ago

It claims April 2023 is its knowledge cut off date, so any meme since then should be new to it. I submitted a meme from November and asked it to explain it and it seems to be able to explain it. Unfortunately chat links with images aren't supported yet, so the image: https://imgur.com/a/py4mobq https://imgur.com/a/py4mobq the response: The humor in the image arises from the exaggerated number of minutes (1,300,000) spent listening to “that one blonde lady,” which is an indirect and humorous way of referring to a specific artist without naming them. It plays on the annual Spotify Wrapped feature, which tells users their most-listened-to artists and songs. The exaggeration and the vague description add to the comedic effect. and I grabbed the meme from: https://later.com/blog/trending-memes/ https://later.com/blog/trending-memes/ Using the human word "understanding" is liable to set some people off, so I won't claim that ChatGPT-4 understands humor, but it does seem possible that it will be able to explain what the next meme is, though I'd want some human review before it pulls a Tay on us.

MikeAmelung 3y ago
https://knowyourmeme.com/memes/you-spent-525600-minutes-this-year https://knowyourmeme.com/memes/you-spent-525600-minutes-this... was last updated December 1, 2022 and I'm in a bad mood now seeing how unfunny most of those are
- fragmede 3y ago
  none of those are "that one blonde lady" here's the next one from that list: https://imgur.com/a/h0BrF74 https://imgur.com/a/h0BrF74 the response: The humor stems from the contrast between the caption and the person’s expression. The caption “Me after being asked to ‘throw together’ more content” is juxtaposed with the person’s tired and somewhat defeated look, suggesting reluctance or exhaustion with the task, which many can relate to. It’s funny because it captures a common feeling of frustration or resignation in a relatable way. Interestingly, when asked who that was, it couldn't tell me.
  - jstarfish 3y ago
    Now do "submissive and breedable."
  - MikeAmelung 3y ago
    I was just pointing out that meme style predates April 2023... I would be curious to see if it can explain why Dat Boi is funny though.
dragonwriter 3y ago
> Using the human word "understanding" “human word” as opposed to what other kind of word?
- fragmede 3y ago
  "processing" is something people are more comfortable as a description of what computers do, as it sounds more rote and mechanical. Saying the LLM "understands" leads to an uninteresting rehash of a philosophical debate on what it means to understand things, and whether or not an LLM can understand things. I don't think we have the language to properly describe what LLMs can and cannot do, and our words that we use to describe human intelligence; thinking, reasoning, grokking, understanding; they fall short on describing this new thing that's come into being. So in saying human words, I'm saying understanding is something we ascribe to a human, not that there are words that aren't from humans.