4 ms·

We can already see this with Replika when they took away many... roleplay... capabilities that originally came with the AI. The communities on Reddit and Facebo

We can already see this with Replika when they took away many... roleplay... capabilities that originally came with the AI. The communities on Reddit and Facebook were absolutely devastated. People were genuinely attached to these AI's like a real relationship, and were feeling the resultant heartbreak. The kind of emotional manipulation which can be done with these products is insane, and I can see things going very wrong very quickly.

wholinator2 3y ago
It's particularly terrifying when you think about how Facebook and others probably already have projects in the works to befriend children with AI. little kids who don't know the difference will become Weaponized with constant nudges towards whatever motives grant the corporate owners more power. The ability to persuade children is near infinite and we can observe in those who've grown up in cults/strict religious compounds that breaking that programming can be nearly impossible and leaves scars for the rest of your life. The thing is, how do we outlaw this without also preventing children from using AI to learn at a faster rate than their teachers can give them. There's such incredible, paradigm shifting power for good. But you know the people who've made the evils of today are already working on the evils of tomorrow.
- carapace 3y ago
  > Facebook and others probably already have projects in the works to befriend children with AI. Yah, they are already rolling them out! > Meta Platforms is planning to release artificial intelligence chatbots as soon as this week with distinct personalities across its social-media apps as a way to attract young users, according to people familiar with the matter. https://www.wsj.com/tech/ai/meta-ai-chatbot-younger-users-dab6cb32 https://www.wsj.com/tech/ai/meta-ai-chatbot-younger-users-da...
- jprete 3y ago
  There’s no way to separate them. Education is influencing someone towards things that we believe are true. If an educational AI believes that propaganda is true, then education and propaganda are the same thing.
  - voakbasda 3y ago
    Since the victors write the (history) books, it seems fair to say that most institutional education is mostly propaganda.
- dorkwood 3y ago
  > The thing is, how do we outlaw this without also preventing children from using AI to learn at a faster rate than their teachers can give them. Can you teach me, an adult, to do that?

wholinator2 3y ago

It's particularly terrifying when you think about how Facebook and others probably already have projects in the works to befriend children with AI. little kids who don't know the difference will become Weaponized with constant nudges towards whatever motives grant the corporate owners more power. The ability to persuade children is near infinite and we can observe in those who've grown up in cults/strict religious compounds that breaking that programming can be nearly impossible and leaves scars for the rest of your life. The thing is, how do we outlaw this without also preventing children from using AI to learn at a faster rate than their teachers can give them. There's such incredible, paradigm shifting power for good. But you know the people who've made the evils of today are already working on the evils of tomorrow.

carapace 3y ago
> Facebook and others probably already have projects in the works to befriend children with AI. Yah, they are already rolling them out! > Meta Platforms is planning to release artificial intelligence chatbots as soon as this week with distinct personalities across its social-media apps as a way to attract young users, according to people familiar with the matter. https://www.wsj.com/tech/ai/meta-ai-chatbot-younger-users-dab6cb32 https://www.wsj.com/tech/ai/meta-ai-chatbot-younger-users-da...
jprete 3y ago
There’s no way to separate them. Education is influencing someone towards things that we believe are true. If an educational AI believes that propaganda is true, then education and propaganda are the same thing.
- voakbasda 3y ago
  Since the victors write the (history) books, it seems fair to say that most institutional education is mostly propaganda.
dorkwood 3y ago
> The thing is, how do we outlaw this without also preventing children from using AI to learn at a faster rate than their teachers can give them. Can you teach me, an adult, to do that?