4 ms·

Morality and politics are ultimately just mechanisms to allow us to live with each other efficiently. Has anyone formulated any kind of argument that shows tha

Morality and politics are ultimately just mechanisms to allow us to live with each other efficiently. Has anyone formulated any kind of argument that shows that AIs created by training on data will have any politics and morality whatsoever? I think the instrumental goals which are the easiest to discover are the sociopathic ones. The behavior of children seems to indicate this.

proc0 4y ago
Right, we don't know enough about the brain and/or conscious experience to determine where and how morality arises. In a way this is part of the risk. We might stumble on emergent morality with a large enough language model and not know until it starts happening with real consequences.
zmmmmm 4y ago
> Has anyone formulated any kind of argument that shows that AIs created by training on data will have any politics I fully expect that it won't be long before the same pattern we see in other areas of tech plays out. That is, the right starts alleging left wing bias in all of these networks and even starts campaigning for laws to constrain them to represent right wing points of view. Of course, this is betraying my own bias which is roughly in line with Colbert's "It is a well known fact that reality has liberal bias". That is, right wing views are intrinsically rooted in principle and preconceived beliefs rather than observable facts and so there is always going to be a problem to get LLMs which are heavily constrained to train on what is observable to give even representation to things that aren't supported by observable facts.
- stcredzero 4y ago
  I fully expect that it won't be long before the same pattern we see in other areas of tech plays out. That is, the right starts alleging left wing bias... Jeez. Left/right has nothing to do with this. Go and watch "The Fly" and ponder Brundle's comment about wanting to be the first insect politician.
dragonwriter 4y ago
> Has anyone formulated any kind of argument that shows that AIs created by training on data will have any politics and morality whatsoever? If no careful alignment work is put in, AIs will have political biases as an incidental result of the content of the training data. If careful alignment work is put in, AIs will have political biases selected as part of the alignment work. Both forms are readily observable in AI far short of AGI.

proc0 4y ago

Right, we don't know enough about the brain and/or conscious experience to determine where and how morality arises. In a way this is part of the risk. We might stumble on emergent morality with a large enough language model and not know until it starts happening with real consequences.

zmmmmm 4y ago

> Has anyone formulated any kind of argument that shows that AIs created by training on data will have any politics I fully expect that it won't be long before the same pattern we see in other areas of tech plays out. That is, the right starts alleging left wing bias in all of these networks and even starts campaigning for laws to constrain them to represent right wing points of view. Of course, this is betraying my own bias which is roughly in line with Colbert's "It is a well known fact that reality has liberal bias". That is, right wing views are intrinsically rooted in principle and preconceived beliefs rather than observable facts and so there is always going to be a problem to get LLMs which are heavily constrained to train on what is observable to give even representation to things that aren't supported by observable facts.

stcredzero 4y ago
I fully expect that it won't be long before the same pattern we see in other areas of tech plays out. That is, the right starts alleging left wing bias... Jeez. Left/right has nothing to do with this. Go and watch "The Fly" and ponder Brundle's comment about wanting to be the first insect politician.

dragonwriter 4y ago

> Has anyone formulated any kind of argument that shows that AIs created by training on data will have any politics and morality whatsoever? If no careful alignment work is put in, AIs will have political biases as an incidental result of the content of the training data. If careful alignment work is put in, AIs will have political biases selected as part of the alignment work. Both forms are readily observable in AI far short of AGI.