4 ms·

It says a lot about what injustices we have learned to accept that AI alarmists focus almost exclusively on the scifi-level hypothetical dangers of AI, rather t

It says a lot about what injustices we have learned to accept that AI alarmists focus almost exclusively on the scifi-level hypothetical dangers of AI, rather than the very real problems it already causes today. Those problems largely fall into three categories that I can think of off the top of my head at 1am: 1. AI is a convenient way to justify potentially uncomfortable decisions you would have made otherwise (idlewords said it best: "AI is money laundering for bias") 2. AI is being used in situations where it can be a threat to life and limb, like the current crop of self-driving(ish) cars 3. Essentially all of the gains from automating work going to people who already have capital

bpodgursky 5y ago
"AI alarmists" are worried because the worst-case outcomes of AGI are mistakes you cannot ever fix. All the rest of these are bad, but they are problems we can fix given time and thought, because we will still exist. Extinction-level events decrease all future human utility to zero, and so should be treated with extraordinary care.
- est31 5y ago
  As you are talking about extinction level events, I'm not very confident that if humans have ultimate say over nuclear weapons, we will continue to not end our species with them. It might in fact be a good idea to establish an AGI overlord which watches over humans and enforces nuclear non proliferation policies. If you look through history, it's full with war, genocide, and similar. Human societies are bound for change, and while it's been a peaceful few decades in which we had the nuclear button, it's basically ensured that we'll press it in the next 10 thousand years. How will technological civilization become million years old if not with the help of an AGI that enforces basic rules like "don't nuke each other"?
  - samatman 5y ago
    > It might in fact be a good idea to establish an AGI overlord which Does whatever it damn well pleases.

bpodgursky 5y ago

"AI alarmists" are worried because the worst-case outcomes of AGI are mistakes you cannot ever fix. All the rest of these are bad, but they are problems we can fix given time and thought, because we will still exist. Extinction-level events decrease all future human utility to zero, and so should be treated with extraordinary care.

est31 5y ago
As you are talking about extinction level events, I'm not very confident that if humans have ultimate say over nuclear weapons, we will continue to not end our species with them. It might in fact be a good idea to establish an AGI overlord which watches over humans and enforces nuclear non proliferation policies. If you look through history, it's full with war, genocide, and similar. Human societies are bound for change, and while it's been a peaceful few decades in which we had the nuclear button, it's basically ensured that we'll press it in the next 10 thousand years. How will technological civilization become million years old if not with the help of an AGI that enforces basic rules like "don't nuke each other"?
- samatman 5y ago
  > It might in fact be a good idea to establish an AGI overlord which Does whatever it damn well pleases.