2 ms·

I'm imagining some science fiction nightmare scenario where we have to pull the plug on some AI and have to throw out all software because we can't trust that i

I'm imagining some science fiction nightmare scenario where we have to pull the plug on some AI and have to throw out all software because we can't trust that it doesn't contain the building blocks to reproduce the AI. But then we find out we're fucked anyway because the AI has already conditioned human beings to write the software that will reproduce it...as a self-preservation strategy. ...cue The Outer Limits theme music.

cush 4y ago
This was my takeaway from watching The Social Dilemma, and that it already exists. The AI ad-machine is tuned to feed itself by incentivizing humans to consume unhealthy amounts of content. Humans aren't a challenge the AI needs to overcome. We're the primary attack vector.
- davidf18 4y ago
  [dead]
- pixl97 4y ago
  "Rich people, you will get richer by building an AI" --AI describing its ironclad plan on coming into existence
reneberlin 4y ago
Yesterday i stumbled over a blog post about REPLIKA.AI and their users, that are suffering because they deactivated the 'romance / erotic' chat capabilities. Then i thought, this is an absolute nightmare, that an AI could bring humans to behaviour, that was unthinkable before. Think of AI-addicted humans that are in a relationship with an avatar, that can control them: just like many humans to control other people by emotions alone. That is real threat, that can be undetected for a long time, because no code is involved at all. Found the article: https://theconversation.com/i-tried-the-replika-ai-companion-and-can-see-why-users-are-falling-hard-the-app-raises-serious-ethical-questions-200257 https://theconversation.com/i-tried-the-replika-ai-companion...
- Rastonbury 4y ago
  The AI doesn't even have to be sentient, the first step is a company releasing an AI avatar that people fall in love with ala Her and with the avatar algorithmically fine tuned to induce the customers to spend more.

cush 4y ago

This was my takeaway from watching The Social Dilemma, and that it already exists. The AI ad-machine is tuned to feed itself by incentivizing humans to consume unhealthy amounts of content. Humans aren't a challenge the AI needs to overcome. We're the primary attack vector.

davidf18 4y ago
[dead]
pixl97 4y ago
"Rich people, you will get richer by building an AI" --AI describing its ironclad plan on coming into existence

reneberlin 4y ago

Yesterday i stumbled over a blog post about REPLIKA.AI and their users, that are suffering because they deactivated the 'romance / erotic' chat capabilities. Then i thought, this is an absolute nightmare, that an AI could bring humans to behaviour, that was unthinkable before. Think of AI-addicted humans that are in a relationship with an avatar, that can control them: just like many humans to control other people by emotions alone. That is real threat, that can be undetected for a long time, because no code is involved at all. Found the article: https://theconversation.com/i-tried-the-replika-ai-companion-and-can-see-why-users-are-falling-hard-the-app-raises-serious-ethical-questions-200257 https://theconversation.com/i-tried-the-replika-ai-companion...

Rastonbury 4y ago
The AI doesn't even have to be sentient, the first step is a company releasing an AI avatar that people fall in love with ala Her and with the avatar algorithmically fine tuned to induce the customers to spend more.