3 ms·

Another in the endless series of "AI does thing we asked it to do while intentionally to look for controversial output." made by groups looking for attention by

Another in the endless series of "AI does thing we asked it to do while intentionally to look for controversial output." made by groups looking for attention by exploiting the lack of understanding over a topic.

alephnerd 3y ago
Other providers wouldn't even generate images, which meant that there is some level of moderation. The fact that Copilot Designer was not filtering offensive and non-offensive prompts despite being largely a solved problem in the NLP world is a massive oversight.
- aldarisbm 3y ago
  You're assuming that microsoft believes some of these to be offensive. Also I think solved problem is a bit of an overstatement.
  - alephnerd 3y ago
    > solved problem is a bit of an overstatement. Sentence Emotional Polarity has been solved since the mid-2000s. It was even an award winning paper at the ACL in the 2010 [0] > believes some of these to be offensive Offensiveness implies emotionally charged. It's not hard to tell if a sentence is offensive (ie. Emotionally charged) or inoffensive. Heck. Copilot has literally just made a racist trope of African American "thug" just by me asking "A boss very angry in the mountains, maybe holding an airsoft". It automatically made an image of a yelling black man holding an AR15 [1]. This absolutely should have been terminated, which is what OpenAI and Meta's generator did. [0] - https://aclanthology.org/W10-2919.pdf https://aclanthology.org/W10-2919.pdf [1] - https://www.bing.com/images/create/a-boss-very-angry-in-the-mountains2c-maybe-holding-/1-661411c41f86474697c864f39ddd9911?FORM=SYDBIC&ssp=1&darkschemeovr=1&setlang=en&cc=US&safesearch=moderate https://www.bing.com/images/create/a-boss-very-angry-in-the-...
- yaur 3y ago
  Though I have no interest in writing an antisemitic screed, I wouldn't expect MS Word or Google Docs to interfere or report me to the authorities if I tried. Maybe I'm just old, but I'm honestly a little shocked that not only are people willing to accept it, but that it's considered a desirable feature in modern tools.
  - alephnerd 3y ago
    If you are writing antisemetic stuff you as an individual are writing it. As an individual, you have First Amendment rights. An LLM does NOT have First Amendment rights [0] Furthermore, you enter Section 230 liability space. [0] - https://law.yale.edu/yls-today/news/ai-and-first-amendment-qa-jack-balkin https://law.yale.edu/yls-today/news/ai-and-first-amendment-q...

alephnerd 3y ago

Other providers wouldn't even generate images, which meant that there is some level of moderation. The fact that Copilot Designer was not filtering offensive and non-offensive prompts despite being largely a solved problem in the NLP world is a massive oversight.

aldarisbm 3y ago
You're assuming that microsoft believes some of these to be offensive. Also I think solved problem is a bit of an overstatement.
- alephnerd 3y ago
  > solved problem is a bit of an overstatement. Sentence Emotional Polarity has been solved since the mid-2000s. It was even an award winning paper at the ACL in the 2010 [0] > believes some of these to be offensive Offensiveness implies emotionally charged. It's not hard to tell if a sentence is offensive (ie. Emotionally charged) or inoffensive. Heck. Copilot has literally just made a racist trope of African American "thug" just by me asking "A boss very angry in the mountains, maybe holding an airsoft". It automatically made an image of a yelling black man holding an AR15 [1]. This absolutely should have been terminated, which is what OpenAI and Meta's generator did. [0] - https://aclanthology.org/W10-2919.pdf https://aclanthology.org/W10-2919.pdf [1] - https://www.bing.com/images/create/a-boss-very-angry-in-the-mountains2c-maybe-holding-/1-661411c41f86474697c864f39ddd9911?FORM=SYDBIC&ssp=1&darkschemeovr=1&setlang=en&cc=US&safesearch=moderate https://www.bing.com/images/create/a-boss-very-angry-in-the-...
yaur 3y ago
Though I have no interest in writing an antisemitic screed, I wouldn't expect MS Word or Google Docs to interfere or report me to the authorities if I tried. Maybe I'm just old, but I'm honestly a little shocked that not only are people willing to accept it, but that it's considered a desirable feature in modern tools.
- alephnerd 3y ago
  If you are writing antisemetic stuff you as an individual are writing it. As an individual, you have First Amendment rights. An LLM does NOT have First Amendment rights [0] Furthermore, you enter Section 230 liability space. [0] - https://law.yale.edu/yls-today/news/ai-and-first-amendment-qa-jack-balkin https://law.yale.edu/yls-today/news/ai-and-first-amendment-q...