4 ms·

> And we can assume that AI can even iterate on and develop on its own understanding of these complex calculations much faster than a human can, making it signi

by HKH2 3y ago

> And we can assume that AI can even iterate on and develop on its own understanding of these complex calculations much faster than a human can, making it significantly better at navigating moral issues. Yeah, like judging human history and deciding murderous humans need to be removed from the earth or enslaved for their own benefit. (Some people already argue that the world would be better off without humans.) Also, we know torture is wrong because we have a sense of pain, but an AI would just have to take our word for it. That doesn't seem too balanced to me.

kouru225 3y ago
>Yeah, like judging human history and deciding murderous humans need to be removed from the earth or enslaved for their own benefit. (Some people already argue that the world would be better off without humans.) >Also, we know torture is wrong because we have a sense of pain, but an AI would just have to take our word for it. That doesn't seem too balanced to me. Again, you have this innate belief that immorality is somehow strategically beneficial and IMO you should really look into that
- HKH2 3y ago
  I have the belief that humans are innately selfish and shortsighted. Obviously corruption is not viable long-term. Laws should make corruption not strategically beneficial, but if you can find loopholes or people to bribe, they are more or less irrelevant. What would make an AGI not try to game the system?
  - kouru225 3y ago
    Lemme ask you: if murder were legal do you think we’d be able to build and produce so much? Of course not. It doesn’t matter what the laws are. Reality makes corruption strategically unviable.
    - HKH2 3y ago
      True. Let me be more precise: the legal system forces (or is meant to force) shortsighted people to deal with long-term consequences. The law is constantly revised to preempt future consequences, but it is not perfect. (Ex post facto laws are used to punish people who have committed actions that were legal at the time. Loopholes will always exist because language is always somewhat imprecise.) Now, you might say that AGI will be able to perfectly predict the future of all actions and make the legal system redundant. Ignoring the absurd amount of possibilities, I struggle to believe it's possible because an AGI has no sense of pain to give actions weight; it just has to follow human precedent. Seeming good enough, it could steer humanity into a dead end unknowingly. Also, it might decide that a few eggs have to be broken to make a utopian omelette.

by HKH2 3y ago

kouru225 3y ago

>Yeah, like judging human history and deciding murderous humans need to be removed from the earth or enslaved for their own benefit. (Some people already argue that the world would be better off without humans.) >Also, we know torture is wrong because we have a sense of pain, but an AI would just have to take our word for it. That doesn't seem too balanced to me. Again, you have this innate belief that immorality is somehow strategically beneficial and IMO you should really look into that

HKH2 3y ago
I have the belief that humans are innately selfish and shortsighted. Obviously corruption is not viable long-term. Laws should make corruption not strategically beneficial, but if you can find loopholes or people to bribe, they are more or less irrelevant. What would make an AGI not try to game the system?
- kouru225 3y ago
  Lemme ask you: if murder were legal do you think we’d be able to build and produce so much? Of course not. It doesn’t matter what the laws are. Reality makes corruption strategically unviable.
  - HKH2 3y ago
    True. Let me be more precise: the legal system forces (or is meant to force) shortsighted people to deal with long-term consequences. The law is constantly revised to preempt future consequences, but it is not perfect. (Ex post facto laws are used to punish people who have committed actions that were legal at the time. Loopholes will always exist because language is always somewhat imprecise.) Now, you might say that AGI will be able to perfectly predict the future of all actions and make the legal system redundant. Ignoring the absurd amount of possibilities, I struggle to believe it's possible because an AGI has no sense of pain to give actions weight; it just has to follow human precedent. Seeming good enough, it could steer humanity into a dead end unknowingly. Also, it might decide that a few eggs have to be broken to make a utopian omelette.