3 ms·
"anthropomorphizing ML models" seems like the complete opposite of what AI safety people do. They often point out that just because you are intelligent, you do
by petters 4y ago
"anthropomorphizing ML models" seems like the complete opposite of what AI safety people do.
They often point out that just because you are intelligent, you don't have to seem human. I think they call it the "orthogonality thesis".
- heavyset_go 4y agoAnthropomorphism isn't just about directly comparing things to people, it's also about assigning qualities that are related to people, like motivations, goals, opinions, concepts like good and bad, etc, even if the specific qualities would be alien to most people. In that sense, the AI safety crowd has been anthropomorphizing hypothetical AI for close to 20 years now.
- brian_cloutier 4y agoDo you have an example of someone in the community making this mistake? My understanding is that if we knew that all future AGIs would have human-like motivations, goals, opinions, and concepts of good and bad then that crowd would be much less concerned. Smarter humans are not the concern. Intelligences which are _not_ human-like are the explicit concern.
- heavyset_go 4y agoRoko's basilisk comes to mind.