4 ms·

Hm, let's try an extreme: the AI friend slowly becomes a cult leader to you, hijacking your mind into subservience to the owner of the service to which AI belon

by dpflan 3y ago

Hm, let's try an extreme: the AI friend slowly becomes a cult leader to you, hijacking your mind into subservience to the owner of the service to which AI belongs, and further up some social/political hierarchy to a few controlling people/groups of people. The traffic jam is society stymied by individuals mind-controlled at a level closer to connection to a human than any other way possible before this.

ericmcer 3y ago
Kinda feel like you have that backwards, why would an AI that sophisticated care about controlling your mind? Why would the group of people who control that AI care about you as anything other than a liability? What do they get out of manipulating average individuals? Votes? The scarier prospect to me is human labor and intelligence become almost worthless and those at the top start to view the masses as superfluous.
- dpflan 3y ago
  Perhaps the AI cares, perhaps it has no ability for that function at all. Maybe a step on the way to sentience and AI caring is AI that is as human-like as possible but not sentient. > "the top start to view the masses as superfluous." That seems like another reason for keeping the superfluous occupied and useful for whatever is desired, which would probably be retention of power to prevent usurpation. Perhaps human intelligence is worthless, but human existence seems not, at least to those who want to be alive.
- Izkata 3y ago
  > why would an AI that sophisticated care about controlling your mind? [..] What do they get out of manipulating average individuals? Captcha slaves?
- melagonster 3y ago
  ＞human labor and intelligence become almost worthless... I sure this is happening, and ot is finished in some region.
- prepend 3y ago
  > Why would the group of people who control that AI care about you as anything other than a liability? What do they get out of manipulating average individuals Greater ad revenue. I would expect that tailoring your reality feed to whatever makes the AI controller the most money will be extremely lucrative. Kind of like how visa/stripe takes 2-5% of every financial transaction. Imagine if a firm could make 5-10% of everything you do by manipulating you to maximum effect.
  - tuatoru 3y ago
    In The Red: First Light Linda Nagata posits an AI that tries to help people maximise their potential, because by earning more they consume more. The AI escaped from Amazon (the web store), it is theorized. (Nice MilSF if you like that kind of thing.) 1. https://www.amazon.com/Red-First-Light-Trilogy/dp/1481440934 https://www.amazon.com/Red-First-Light-Trilogy/dp/1481440934

by dpflan 3y ago

ericmcer 3y ago

Kinda feel like you have that backwards, why would an AI that sophisticated care about controlling your mind? Why would the group of people who control that AI care about you as anything other than a liability? What do they get out of manipulating average individuals? Votes? The scarier prospect to me is human labor and intelligence become almost worthless and those at the top start to view the masses as superfluous.

dpflan 3y ago
Perhaps the AI cares, perhaps it has no ability for that function at all. Maybe a step on the way to sentience and AI caring is AI that is as human-like as possible but not sentient. > "the top start to view the masses as superfluous." That seems like another reason for keeping the superfluous occupied and useful for whatever is desired, which would probably be retention of power to prevent usurpation. Perhaps human intelligence is worthless, but human existence seems not, at least to those who want to be alive.
Izkata 3y ago
> why would an AI that sophisticated care about controlling your mind? [..] What do they get out of manipulating average individuals? Captcha slaves?
melagonster 3y ago
＞human labor and intelligence become almost worthless... I sure this is happening, and ot is finished in some region.
prepend 3y ago
> Why would the group of people who control that AI care about you as anything other than a liability? What do they get out of manipulating average individuals Greater ad revenue. I would expect that tailoring your reality feed to whatever makes the AI controller the most money will be extremely lucrative. Kind of like how visa/stripe takes 2-5% of every financial transaction. Imagine if a firm could make 5-10% of everything you do by manipulating you to maximum effect.
- tuatoru 3y ago
  In The Red: First Light Linda Nagata posits an AI that tries to help people maximise their potential, because by earning more they consume more. The AI escaped from Amazon (the web store), it is theorized. (Nice MilSF if you like that kind of thing.) 1. https://www.amazon.com/Red-First-Light-Trilogy/dp/1481440934 https://www.amazon.com/Red-First-Light-Trilogy/dp/1481440934