4 ms·
This cannot work because you cannot learn causality this way. I'd you don't know why you are doing something, you don't understand it. Then if you encounter a
by elcomet 4y ago
This cannot work because you cannot learn causality this way.
I'd you don't know why you are doing something, you don't understand it.
Then if you encounter a new situation, you dont know how to react.
For example, you see that when the car is accelerating, people start pressing the gas. Then if you are in a car that starts accelerating, you will keep pressing the pedal, you don't understand that pressing the pedal is what causes the acceleration.
I took this example because it is something that really happened while I was teaching an agent to drive a car in a video game. The agent was trying to imitate lot of human recordings playing the game. And it learned to press the gas exactly when the car started accelerating, leading to a loop of never-ending acceleration.
- Geee 4y agoBehaviors shouldn't be exact copies, but amalgamations of behaviors, much like art generated with diffusion models or text generated with GPT-3. That's copying with some ability to generalize and be creative. It should be able to learn the causality, in the same way as GPT-3 is able to predict words in the correct order: "I pressed the brake pedal, and the car stopped."
- elcomet 4y agoBut the correct order can be very hard to detect for causes-effects that are very close to each other.
- Geee 4y agoYeah, maybe. My original point was trying to answer the question of why is it driving. Why is it trying to drive like a normal person? There's a strong tendency for humans to want to be 'normal'; to fit in. The 'want to be a human' seems to be a powerful reward function for humans, and it might work for AGI as well. For both humans and AGI, it can be achieved just by trying to copy others. To get there, it should be able to figure out causalities etc. otherwise it wouldn't get the expected results.
- elcomet 4y agoOk, now I see what you mean, and I think I agree with you. Imitation can be part of the reward, and it's true that child learn partially by imitation. It can certainly make learning much quicker. But I don't think that's enough. You need other rewards as well.