2 ms·
You'd use a two-step approach. 1. First create a model that can evaluate how well a task is going; the YT approach can be used here. 2. Then build a real-worl
by amelius 1y ago
You'd use a two-step approach.
1. First create a model that can evaluate how well a task is going; the YT approach can be used here.
2. Then build a real-world robot, and train it by letting it do tasks, and use the first model to supervise it; here the robot can learn to rely on extra senses such as touch/pressure.
- godelski 1y agoYou're agreeing with the parent btw. You've introduced a lot more than just vision. You introduced interventional experimentation. That's a lot more than just observation
- amelius 1y agoWhat I describe is an unsupervised system. What you say ("interventional") sounds like it's human-supervised. But maybe I'm interpreting it in the wrong way, so please correct me if so.
- godelski 1y agoBy "intervention" I mean interacting with the environment. Purpose a hypothesis, test, modify, test. You can frame RL this way though RL usually generates hypotheses that are far too naïve. This looks like a good brief overview (I only skimmed it but wanted to give you more than "lol, google it") http://smithamilli.com/blog/causal-ladder/ http://smithamilli.com/blog/causal-ladder/
- amelius 1y agoYes, you need to let the robot play (interact with the environment) to learn the vision-versus-touch correlations, but you can do so in an unsupervised way (as long as you choose the environment wisely).