3 ms·
There are tons of research projects that do exactly what you're talking about, initializing an agent with zero knowledge in an environment which just provide ru
by govg 6y ago
There are tons of research projects that do exactly what you're talking about, initializing an agent with zero knowledge in an environment which just provide rules of discovery and reward. The agent then takes actions in that space and learns from its own experiences. It's just that it is hard to compare with humans, who have had the benefit of evolution over millions of years. A basic example is that of AlphaGo Zero[1], which learns to play a top level game by being given enough time and just the rules of the game. This is similar to how a child learns to walk, it is just that we only have the capability to model toy situations (a board game in this instance) right now, and access to harder instances (movement in the real world) will slowly come about. There are cases of robots being programmed to poke / move / pick objects to try and learn about their shapes[2], in case you are interested in another such example.
[1] - https://en.wikipedia.org/wiki/AlphaGo_Zero https://en.wikipedia.org/wiki/AlphaGo_Zero
[2] - https://bair.berkeley.edu/blog/2019/03/21/tactile/ https://bair.berkeley.edu/blog/2019/03/21/tactile/
- bildung 6y agoAlphaGo Zero definitely falls in the same category as GPT-3 - yes, this is unsupervised learning, but it still is fundamentally the same approach, exactly because of the way discovery and reward work on the model. This isn't how a child learns to walk at all: A child a priori has the concept of walking, the concept of self, the concept of movement in space, the concept of willing to walk etc. - it just doesn't have the motoric control. The small part of training motoric control through repeated trial and error is indeed similar to what unsupervised learning models, but the important part is missing.