2 ms·
Yes, I wholly agree. Let's say we make an AI agent and it creates a hypothesis. How is it going to test it, to make sure it is causal and not a mere correlation
by visarga 9y ago
Yes, I wholly agree. Let's say we make an AI agent and it creates a hypothesis. How is it going to test it, to make sure it is causal and not a mere correlation? By devising an experiment. So the agent needs to work like a scientist: propose idea, test idea, iterate. Even children learn about the world like that - they interact with the world trying out their ideas and seeing what works and what doesn't.
But when the agent doesn't have access to a simulator or a world where it can play, how could it understand the causal relations, and thus, be able to reason? The most important thing for the agent is access to experimentation, and that's why supervised learning (fixed dataset) is fundamentally limited by comparison to RL (environment based learning).