4 ms·

I think the capacity for suffering increases dramatically with the advent of AI. This was referenced in passing in this article, but underplayed. We've talked a

I think the capacity for suffering increases dramatically with the advent of AI. This was referenced in passing in this article, but underplayed. We've talked about "virtual hell" stuff on HN before. I say let's not even create it. I wouldn't know how to stop it if it were created. Then again I don't know how to "stop the progress of science" either (other than, say, ending humanity altogether). I'm uncomfortable even working at a company that uses machine learning.

okreallywtf 9y ago
Can you go into more detail on your concerns? I feel like fears over AI are greatly exaggerated. In the real world I feel like we've managed to create some pretty impressive suffering and I'm not sure AI would have that big of an impact (it could even reduce it). Everyone who is concerned about AI seems to be trying to predict the post-singularity world, my guess is that in the near term it will just allow those with power and money to have even more power and money (which is already happening). What is your idea of virtual hell exactly? By the way, googling virtual hell brought me to this delightful fossil: http://www.webring.org/l/rd?ring=spooky;id=56;url=http%3A%2F%2Fwww%2Ejust4kidsmagazine%2Ecom%2Fhell%2Fmain%2Ehtml http://www.webring.org/l/rd?ring=spooky;id=56;url=http%3A%2F...
- orblivion 9y ago
  I'm not scared of AI, I'm scared for it. I'm imagining a world where creating an AI that can suffer is inexpensive, and then 4chan discovers it.
- scbrg 9y ago
  Not OP, but I don't think the fear is that AI will take over the world and enslave as all. Rather the other way around. Imagine you can create an artificial consciousness. You could then proceed to cause this AI a tremendous amount of suffering, by submitting it only to whatever input it is that it considers unpleasant. This experiment could then be scaled up on a level unprecedented in history, and it would be possible to submit billions and billions of AI:s to effectively eternal torment. Why? Any reason. Perhaps as revenge on an AI that has acted against your interests, perhaps as a bargaining chip ("if you don't do as I say, I'll create a thousand exact copies of you and torture you"), perhaps just because - because hey, it's not like the world lacks psychos. [edit]: Ah, I see OP answered while I was typing. Oh well :)

okreallywtf 9y ago

Can you go into more detail on your concerns? I feel like fears over AI are greatly exaggerated. In the real world I feel like we've managed to create some pretty impressive suffering and I'm not sure AI would have that big of an impact (it could even reduce it). Everyone who is concerned about AI seems to be trying to predict the post-singularity world, my guess is that in the near term it will just allow those with power and money to have even more power and money (which is already happening). What is your idea of virtual hell exactly? By the way, googling virtual hell brought me to this delightful fossil: http://www.webring.org/l/rd?ring=spooky;id=56;url=http%3A%2F%2Fwww%2Ejust4kidsmagazine%2Ecom%2Fhell%2Fmain%2Ehtml http://www.webring.org/l/rd?ring=spooky;id=56;url=http%3A%2F...

orblivion 9y ago
I'm not scared of AI, I'm scared for it. I'm imagining a world where creating an AI that can suffer is inexpensive, and then 4chan discovers it.
scbrg 9y ago
Not OP, but I don't think the fear is that AI will take over the world and enslave as all. Rather the other way around. Imagine you can create an artificial consciousness. You could then proceed to cause this AI a tremendous amount of suffering, by submitting it only to whatever input it is that it considers unpleasant. This experiment could then be scaled up on a level unprecedented in history, and it would be possible to submit billions and billions of AI:s to effectively eternal torment. Why? Any reason. Perhaps as revenge on an AI that has acted against your interests, perhaps as a bargaining chip ("if you don't do as I say, I'll create a thousand exact copies of you and torture you"), perhaps just because - because hey, it's not like the world lacks psychos. [edit]: Ah, I see OP answered while I was typing. Oh well :)