4 ms·
> And that is why it is never going to work in the real world: games have clear objectives with obvious rewards. The real world, not so much. I encourage you t
by SpaceManNabs 2y ago
> And that is why it is never going to work in the real world: games have clear objectives with obvious rewards. The real world, not so much.
I encourage you to read deepmind's work with robots.
- YeGoblynQueenne 2y agoOh I have. For example I remember this project: >> Quantitatively, the QT-Opt approach succeeded in 96% of the grasp attempts across 700 trial grasps on previously unseen objects. Compared to our previous supervised-learning based grasping approach, which had a 78% success rate, our method reduced the error rate by more than a factor of five. https://research.google/blog/scalable-deep-reinforcement-learning-for-robotic-manipulation/ https://research.google/blog/scalable-deep-reinforcement-lea... That was in 2018. So what do you think, is vision-based robotic manipulation and grasping a solved problem, seven years later? Is QT-Opt now an established industry standard in training robots with RL? Or was that just another project that was announced with great fanfare and hailed as a breakthrough that would surely lead to great increase of capabilities... only to pop, fizzle and disappear in obscurity without any real-world result, a few years later? Like most of DeepMind's RL projects do?
- SpaceManNabs 2y agoLet's look at 2025 https://www.youtube.com/watch?v=x-exzZ-CIUw https://www.youtube.com/watch?v=x-exzZ-CIUw It looks pretty awesome. Let's see what happens.
- YeGoblynQueenne 2y agoNice robot demo. Here's another one: https://youtu.be/03p2CADwGF8?si=BXeWXqu1_3WMS4yy https://youtu.be/03p2CADwGF8?si=BXeWXqu1_3WMS4yy A robot assembling a puzzle with machine vision! And it's only from the 1970's.
- SpaceManNabs 2y agoi dont think those demos are comparable and cool for sharing your link!
- YeGoblynQueenne 2y agoAbsolutely comparable. Consider what can be done today with hardware as powerful as in the 1970's and it's obvious that the needle hasn't budged one tick. But, like you say- let's wait and see. I always do the former but I'm still waiting for the latter.