4 ms·

Why is there a slur list in copilot?

by slim 5y ago

ovi256 5y ago
Because without it, they'll end up with inevitable outraged news posts "New AI coding tool Copilot generates offensive text" killing the project for no good reason.
- axpy906 5y ago
  The flip side is they are taking on additional maintenance there.
  - yunohn 5y ago
    Always better than boring outrage press.
- literallyaduck 5y ago
  Here are some possible headlines: "Copilot doesn't see genders, and that is a bad thing" "Copilot accused of antisemitism after it treats Israel as invisible" "Indy Mech game developers for 'Tank man' confused why Copilot refuses to help"
  - dralley 5y ago
    Those headlines, if they were ever to be written, are a hell of a lot more tame than the ones Microsoft has generated in the past. https://arstechnica.com/information-technology/2016/03/microsoft-terminates-its-tay-ai-chatbot-after-she-turns-into-a-nazi/ https://arstechnica.com/information-technology/2016/03/micro...
  - deleted 5y ago
    [deleted]
Tobu 5y ago
Remember when Microsoft launched a chat bot? https://arstechnica.com/information-technology/2016/03/tay-the-neo-nazi-millennial-chatbot-gets-autopsied/ https://arstechnica.com/information-technology/2016/03/tay-t...
- arc-in-space 5y ago
  This occasionally gets brought up as an example in the context of problems with AI, but is it at all relevant? Per Gwern[0]: > (...) There appear to be several similar AI-related leprechauns: the infamous Tay bot, which was supposedly educated by 4chan into being evil, appears to have been mostly a simple ‘echo’ function (common in chatbots or IRC bots) and the non-“repeat after me” Tay texts are generally short, generic, and cherrypicked out of tens or hundreds of thousands of responses, and it’s highly unclear if Tay ‘learned’ anything at all in the short time that it was operational; [0] https://www.gwern.net/Leprechauns https://www.gwern.net/Leprechauns, self-recommending
  - kzrdude 5y ago
    Thanks for linking to an interesting site
theHIDninja 5y ago
Because there is a certain vocal demographic of people who think words can physically hurt people, so Microsoft needs to go to extreme lengths to avoid that demographic of people from thinking that people are getting physically hurt by using those words.

Why is there a slur list in copilot?

by slim 5y ago

Why is there a slur list in copilot?

Because without it, they'll end up with inevitable outraged news posts "New AI coding tool Copilot generates offensive text" killing the project for no good reason.

axpy906 5y ago
The flip side is they are taking on additional maintenance there.
- yunohn 5y ago
  Always better than boring outrage press.
literallyaduck 5y ago
Here are some possible headlines: "Copilot doesn't see genders, and that is a bad thing" "Copilot accused of antisemitism after it treats Israel as invisible" "Indy Mech game developers for 'Tank man' confused why Copilot refuses to help"
- dralley 5y ago
  Those headlines, if they were ever to be written, are a hell of a lot more tame than the ones Microsoft has generated in the past. https://arstechnica.com/information-technology/2016/03/microsoft-terminates-its-tay-ai-chatbot-after-she-turns-into-a-nazi/ https://arstechnica.com/information-technology/2016/03/micro...
- deleted 5y ago
  [deleted]

Tobu 5y ago

Remember when Microsoft launched a chat bot? https://arstechnica.com/information-technology/2016/03/tay-the-neo-nazi-millennial-chatbot-gets-autopsied/ https://arstechnica.com/information-technology/2016/03/tay-t...

arc-in-space 5y ago
This occasionally gets brought up as an example in the context of problems with AI, but is it at all relevant? Per Gwern[0]: > (...) There appear to be several similar AI-related leprechauns: the infamous Tay bot, which was supposedly educated by 4chan into being evil, appears to have been mostly a simple ‘echo’ function (common in chatbots or IRC bots) and the non-“repeat after me” Tay texts are generally short, generic, and cherrypicked out of tens or hundreds of thousands of responses, and it’s highly unclear if Tay ‘learned’ anything at all in the short time that it was operational; [0] https://www.gwern.net/Leprechauns https://www.gwern.net/Leprechauns, self-recommending
- kzrdude 5y ago
  Thanks for linking to an interesting site

theHIDninja 5y ago

Because there is a certain vocal demographic of people who think words can physically hurt people, so Microsoft needs to go to extreme lengths to avoid that demographic of people from thinking that people are getting physically hurt by using those words.