4 ms·

> have transformed robotics Did they? Where? Seriously, I genuinely want to know who is employing these techniques.

by leonheld 2y ago

bobxmax 2y ago
All frontier labs are now employing LVMs or LLMs. But that's my point is you won't see the fruits of it this early.
- achierius 2y ago
  That's the point being made. It's transformed robotics research, yes, but it both remains to see whether it will have a truly transformative effect on the field as experienced by people outside academia (I think this is quite probable) and more pointedly when.
  - stuartjohnson12 2y ago
    I think this is an opinion borne out of weariness with constant promises that amazing robots are right around the corner (as they have been for 20 odd years now). For anyone who is close to the front line, I think the resounding consensus is clear - this time is different, unbelievably different, and capability development is going to accelerate dramatically.
  - bobxmax 2y ago
    I think it's impossible to spend a lot of time with these models without believing robotics is fundamentally about to transform. Even the most sophisticated versions of robotic logic pre-LLM/VLM feel utterly trivial compared to what even rudimentary applications of these large models can accomplish.
    - lucianbr 2y ago
      > have transformed robotics When questioned: > believing robotics is fundamentally about to transform These are not even remotely the same thing. Something that has happened already and is verifiable fact is not the same thing as your opinion, even if your opinion is based on a lot of sound arguments and reasoning. Very tiresome to read so many claims of fact based on opinion of what will happen in the future.
      - bobxmax 2y ago
        The discussion was about whether robotics was about to transform or not. And obviously it is because of how much basic robotics workloads improve with these models. Really not that hard.
        lucianbr 2y ago
        > have transformed robotics > about to transform Apparently even english tenses are too hard, let alone anything else. Bald faced lie, to claim what you think might happen in the future has already happened in the past. No matter "what the discussion was about", or what arguments you bring to support your estimation of the future.
fragmede 2y ago
https://www.figure.ai/ https://www.figure.ai/ specifically their speech demo video (which is, of course, a demo video) https://youtu.be/Sq1QZB5baNw https://youtu.be/Sq1QZB5baNw https://www.1x.tech/neo https://www.1x.tech/neo and https://www.unitree.com/h1/ https://www.unitree.com/h1/ are undoubtedly using such models. It's an area of active research, eg https://www.physicalintelligence.company/blog/pi0 https://www.physicalintelligence.company/blog/pi0 https://wholebody-b1.github.io/ https://wholebody-b1.github.io/ https://ok-robot.github.io/ https://ok-robot.github.io/ https://mobile-aloha.github.io/ https://mobile-aloha.github.io/

> have transformed robotics Did they? Where? Seriously, I genuinely want to know who is employing these techniques.

bobxmax 2y ago

All frontier labs are now employing LVMs or LLMs. But that's my point is you won't see the fruits of it this early.

achierius 2y ago
That's the point being made. It's transformed robotics research, yes, but it both remains to see whether it will have a truly transformative effect on the field as experienced by people outside academia (I think this is quite probable) and more pointedly when.
- stuartjohnson12 2y ago
  I think this is an opinion borne out of weariness with constant promises that amazing robots are right around the corner (as they have been for 20 odd years now). For anyone who is close to the front line, I think the resounding consensus is clear - this time is different, unbelievably different, and capability development is going to accelerate dramatically.
- bobxmax 2y ago
  I think it's impossible to spend a lot of time with these models without believing robotics is fundamentally about to transform. Even the most sophisticated versions of robotic logic pre-LLM/VLM feel utterly trivial compared to what even rudimentary applications of these large models can accomplish.
  - lucianbr 2y ago
    > have transformed robotics When questioned: > believing robotics is fundamentally about to transform These are not even remotely the same thing. Something that has happened already and is verifiable fact is not the same thing as your opinion, even if your opinion is based on a lot of sound arguments and reasoning. Very tiresome to read so many claims of fact based on opinion of what will happen in the future.
    - bobxmax 2y ago
      The discussion was about whether robotics was about to transform or not. And obviously it is because of how much basic robotics workloads improve with these models. Really not that hard.
      - lucianbr 2y ago
        > have transformed robotics > about to transform Apparently even english tenses are too hard, let alone anything else. Bald faced lie, to claim what you think might happen in the future has already happened in the past. No matter "what the discussion was about", or what arguments you bring to support your estimation of the future.

fragmede 2y ago

https://www.figure.ai/ https://www.figure.ai/ specifically their speech demo video (which is, of course, a demo video) https://youtu.be/Sq1QZB5baNw https://youtu.be/Sq1QZB5baNw https://www.1x.tech/neo https://www.1x.tech/neo and https://www.unitree.com/h1/ https://www.unitree.com/h1/ are undoubtedly using such models. It's an area of active research, eg https://www.physicalintelligence.company/blog/pi0 https://www.physicalintelligence.company/blog/pi0 https://wholebody-b1.github.io/ https://wholebody-b1.github.io/ https://ok-robot.github.io/ https://ok-robot.github.io/ https://mobile-aloha.github.io/ https://mobile-aloha.github.io/