4 ms·
Doesn’t the use of RL here imply some level of simulation?
by ShamelessC 3y ago
Doesn’t the use of RL here imply some level of simulation?
- gwern 3y agoYes, but the key is the RL simulation can be simple & unrealistic since it's used to train offline, not to plan & control live: a control systems approach like the Boston Dynamics requires excellent physics modeling because that's the only way it can do planning or adjust for errors while controlling the actual robot in real time, while the NN is trained to cover many possible physics during development, and at runtime in an actual robot, it just shrugs and adapts to whatever crazy scenario it finds itself in.