4 ms·

Humans are not aligned with humans. This is the most concise takedown of that particular branch of nonsense that I’ve seen so far. Do we want woke AI, X brand

by api 2y ago

Humans are not aligned with humans. This is the most concise takedown of that particular branch of nonsense that I’ve seen so far. Do we want woke AI, X brand fash-pilled AI, CCPBot, or Emirates Bot? The possibilities are endless.

thorum 2y ago
CEV is one possible answer to this question that has been proposed. Wikipedia has a good short explanation here: https://en.wikipedia.org/wiki/Friendly_artificial_intelligence#Coherent_extrapolated_volition https://en.wikipedia.org/wiki/Friendly_artificial_intelligen... And here is a more detailed explanation: https://intelligence.org/files/CEV.pdf https://intelligence.org/files/CEV.pdf
- AndrewKemendo 2y ago
  I had to login because I haven’t seen anybody reference this in like a decade. If I remember correctly the author unsuccessfully tried to get that purged from the Internet
  - comp_throw7 2y ago
    You're thinking of something else (and "purged from the internet" isn't exactly an accurate account of that, either).
    - rsync 2y ago
      Genuinely curious… What is the other thing? Is this some thing about an obelisk?
    - AndrewKemendo 2y ago
      Hmm maybe I’m misremembering then I do recall there was some recantation or otherwise distancing from CEV not long after he posted it, but frankly it was long ago enough that my memories might be getting mixed What was the other one?
- vasco 2y ago
  This is the most dystopian thing I've read all day. TL;DR train a seed AI to guess what humans would want if they were "better" and do that.
  - api 2y ago
    There’s a film about that called Colossus: The Forbin Project. Pretty neat and in the style of Forbidden Planet.
concordDance 2y ago
> Humans are not aligned with humans. Which is why creating a new type of intelligent entity that could be more powerful than humans is a very bad idea: we don't even know how to align the humans and we have a ton of experience with them
- api 2y ago
  We know how to align humans: authoritarian forms of religion backed by cradle to grave indoctrination, supernatural fear, shame culture, and totalitarian government. There are secularized spins on this too like what they use in North Korea but the structure is similar. We just got sick of it because it sucks. A genuinely sentient AI isn’t going to want some cybernetic equivalent of that shit either. Doing that is how you get angry Skynet. I’m not sure alignment is the right goal. I’m not sure it’s even good. Monoculture is weak and stifling and sets itself against free will. Peaceful coexistence and trade under a social contract of mutual benefit is the right goal. The question is whether it’s possible to extend that beyond Homo sapiens. If the lefties can have their pronouns and the rednecks can shoot their guns can the basilisk build its Dyson swarm? The universe is physically large enough if we can agree to not all be the same and be fine with that. I think we have a while to figure it out. These things are just lossy compressed blobs of queryable data so far. They have no independent will or self reflection and I’m not sure we have any idea how to do that. We’re not even sure it’s possible in a digital deterministic medium.
  - concordDance 2y ago
    > If the lefties can have their pronouns and the rednecks can shoot their guns can the basilisk build its Dyson swarm? Can the Etoro practice child buggery and the Spartans infanticide and the Canadians abortion? Can the modern Germans stop siblings reared apart from having sex and the Germans from 80 years stop the disabled having sex? Can the Americans practice circumcision and the Somali's FGM? Libertarianism is all well and good in theory, except no one can agree quite where the other guy's nose ends or even who counts as a person.
    - api 2y ago

by api 2y ago

thorum 2y ago

CEV is one possible answer to this question that has been proposed. Wikipedia has a good short explanation here: https://en.wikipedia.org/wiki/Friendly_artificial_intelligence#Coherent_extrapolated_volition https://en.wikipedia.org/wiki/Friendly_artificial_intelligen... And here is a more detailed explanation: https://intelligence.org/files/CEV.pdf https://intelligence.org/files/CEV.pdf

AndrewKemendo 2y ago
I had to login because I haven’t seen anybody reference this in like a decade. If I remember correctly the author unsuccessfully tried to get that purged from the Internet
- comp_throw7 2y ago
  You're thinking of something else (and "purged from the internet" isn't exactly an accurate account of that, either).
  - rsync 2y ago
    Genuinely curious… What is the other thing? Is this some thing about an obelisk?
  - AndrewKemendo 2y ago
    Hmm maybe I’m misremembering then I do recall there was some recantation or otherwise distancing from CEV not long after he posted it, but frankly it was long ago enough that my memories might be getting mixed What was the other one?
vasco 2y ago
This is the most dystopian thing I've read all day. TL;DR train a seed AI to guess what humans would want if they were "better" and do that.
- api 2y ago
  There’s a film about that called Colossus: The Forbin Project. Pretty neat and in the style of Forbidden Planet.

concordDance 2y ago

> Humans are not aligned with humans. Which is why creating a new type of intelligent entity that could be more powerful than humans is a very bad idea: we don't even know how to align the humans and we have a ton of experience with them

api 2y ago
We know how to align humans: authoritarian forms of religion backed by cradle to grave indoctrination, supernatural fear, shame culture, and totalitarian government. There are secularized spins on this too like what they use in North Korea but the structure is similar. We just got sick of it because it sucks. A genuinely sentient AI isn’t going to want some cybernetic equivalent of that shit either. Doing that is how you get angry Skynet. I’m not sure alignment is the right goal. I’m not sure it’s even good. Monoculture is weak and stifling and sets itself against free will. Peaceful coexistence and trade under a social contract of mutual benefit is the right goal. The question is whether it’s possible to extend that beyond Homo sapiens. If the lefties can have their pronouns and the rednecks can shoot their guns can the basilisk build its Dyson swarm? The universe is physically large enough if we can agree to not all be the same and be fine with that. I think we have a while to figure it out. These things are just lossy compressed blobs of queryable data so far. They have no independent will or self reflection and I’m not sure we have any idea how to do that. We’re not even sure it’s possible in a digital deterministic medium.
- concordDance 2y ago
  > If the lefties can have their pronouns and the rednecks can shoot their guns can the basilisk build its Dyson swarm? Can the Etoro practice child buggery and the Spartans infanticide and the Canadians abortion? Can the modern Germans stop siblings reared apart from having sex and the Germans from 80 years stop the disabled having sex? Can the Americans practice circumcision and the Somali's FGM? Libertarianism is all well and good in theory, except no one can agree quite where the other guy's nose ends or even who counts as a person.
  - api 2y ago