The only solution to human-friendly AI is to instantiate a quaila-producing consciousness. Qualia is, by definition, data that non-conscious entities lack. We

The only solution to human-friendly AI is to instantiate a quaila-producing consciousness. Qualia is, by definition, data that non-conscious entities lack. We don’t have to understand what qualia is or how consciousness works in order to train software to develop both. All we need to do is understand how the qualia data affects behavior. If we train toward those unique behaviors that only qualia can provide, then ML will figure out how to produce consciousness and qualia on its own. What is that behavior? Empathy. Empathy is knowing what it feels like to subjectively experience qualia. I know the feeling of awe when I see something beautiful. I know the feeling of pain when I lose a loved one. I know the feeling of jubilance when I succeed. And because I know what it feels like, I know what it feels like for another. And that is real data that allows me to understand what another person will say and do, and to understand what I should say and do with respect to their state. This is real data, and luckily it doesn’t take a super-intelligent AI to produce. See your dog (and perhaps cat). A dog only understands your feelings because it too has those feelings. We don’t need to train for intelligence to solve the question of meaning. We need to train models that demonstrate empathy. I’m not aware of any research in this area. But Douglass Adams’ happy sliding doors and depressed androids were on point.