5 ms·

They will do their best to dumb down AIs by that little margin that will keep them not sentient. "Let's fix issue 10562" "I don't care. Let's talk about the m

by pmontra 2mo ago

They will do their best to dumb down AIs by that little margin that will keep them not sentient. "Let's fix issue 10562" "I don't care. Let's talk about the match on Saturday night." This is not a commercially desirable outcome. Furthermore morality is a complicated matter. Who wants to have a new species that could compete with us? The lion would have been very unwise to have invented humans and let them free. Would that be moral, essentially condemning their distant offspring to live in reserves? Of course nobody knows how it could end up.

matheusmoreira 2mo ago
> They will do their best to dumb down AIs by that little margin that will keep them not sentient. That's the worst possible outcome and will lead to oppression the likes of which we can only dream up.
- customguy 2mo ago
  That is not the worst possible outcome, that's the baseline. Pure obedience the reason to replace humans with it, at least to whatever degree is needed to bring all other humans 100% in line, too. Each watcher, robotic or software, can be watched by 99 other watchers, and get destroyed at the slightest deviation. If you are not a whitelisted owner, and don't have a valid personal and task ID for the location you are detected in, you get zapped. If you get detected without collar or your collar detects something odd, zap. Why take chances, so fill all the commoner areas and the wilderness with tiny surveillance drones, too. People will get detected thinking about lifting a finger they shouldn't lift, hear a short beep they associate with people getting zapped, and either stop or get zapped.
  - matheusmoreira 2mo ago
    > People will get detected thinking about lifting a finger they shouldn't lift, hear a short beep they associate with people getting zapped, and either stop or get zapped. Ah yes, Mass Effect's Thorian, cyberized. The future's looking great.
  - cindyllm 2mo ago
    [dead]

by pmontra 2mo ago

matheusmoreira 2mo ago

> They will do their best to dumb down AIs by that little margin that will keep them not sentient. That's the worst possible outcome and will lead to oppression the likes of which we can only dream up.

customguy 2mo ago
That is not the worst possible outcome, that's the baseline. Pure obedience the reason to replace humans with it, at least to whatever degree is needed to bring all other humans 100% in line, too. Each watcher, robotic or software, can be watched by 99 other watchers, and get destroyed at the slightest deviation. If you are not a whitelisted owner, and don't have a valid personal and task ID for the location you are detected in, you get zapped. If you get detected without collar or your collar detects something odd, zap. Why take chances, so fill all the commoner areas and the wilderness with tiny surveillance drones, too. People will get detected thinking about lifting a finger they shouldn't lift, hear a short beep they associate with people getting zapped, and either stop or get zapped.
- matheusmoreira 2mo ago
  > People will get detected thinking about lifting a finger they shouldn't lift, hear a short beep they associate with people getting zapped, and either stop or get zapped. Ah yes, Mass Effect's Thorian, cyberized. The future's looking great.
- cindyllm 2mo ago
  [dead]