3 ms·

> A self-driving car with a vision-language-action model inside buzzes by. Vision-action maybe. Jamming language in the middle there is an indicator you should

> A self-driving car with a vision-language-action model inside buzzes by. Vision-action maybe. Jamming language in the middle there is an indicator you should run for public office.

red75prime 9mo ago
Language allows higher-level and longer-term planning and better generalization than purely vision-action models. Waymo uses VLM in their Driver[1]. Tesla decided to add some kind of a language model to their VA stack[2]. Nvidia's Alpamayo uses VLA[3]. [1] https://waymo.com/blog/2025/12/demonstrably-safe-ai-for-autonomous-driving https://waymo.com/blog/2025/12/demonstrably-safe-ai-for-auto... [2] https://x.com/aelluswamy/status/1981760576591393203 https://x.com/aelluswamy/status/1981760576591393203 [3] https://www.nvidia.com/en-gb/solutions/autonomous-vehicles/alpamayo/ https://www.nvidia.com/en-gb/solutions/autonomous-vehicles/a...
- irishcoffee 9mo ago
  > Language allows If a tree falls... Waymo, X, Nvidia. You fucking nailed unbiased.
  - red75prime 9mo ago
    [0] if you want something more academic. What's your gripe with language, anyway? [0] https://arxiv.org/abs/2506.24044 https://arxiv.org/abs/2506.24044
    - irishcoffee 9mo ago
      Language is a construct. > allow[s] higher-level and longer-term planning and better generalization than purely vision-action model People do that part. Languages don't plan, they don't think. They don't _do_ anything at all.
      - red75prime 9mo ago
        Sure. Language just seems to structure a general learning system in a way that allows it to do all those things.
        irishcoffee 9mo ago
        > Sure. Language just seems to structure a general learning system in a way that allows it to do all those things. That's like saying python structures a general system. Python does nothing at all. People use python to create constructs. We've covered this. :)
        red75prime 9mo ago
        Python is not a natural language. A natural language communicates things that are not here and now (essentially everything that occurs naturally). Moreover, language can convey abstractions that exist because of language itself.

> A self-driving car with a vision-language-action model inside buzzes by. Vision-action maybe. Jamming language in the middle there is an indicator you should run for public office.

red75prime 9mo ago

Language allows higher-level and longer-term planning and better generalization than purely vision-action models. Waymo uses VLM in their Driver[1]. Tesla decided to add some kind of a language model to their VA stack[2]. Nvidia's Alpamayo uses VLA[3]. [1] https://waymo.com/blog/2025/12/demonstrably-safe-ai-for-autonomous-driving https://waymo.com/blog/2025/12/demonstrably-safe-ai-for-auto... [2] https://x.com/aelluswamy/status/1981760576591393203 https://x.com/aelluswamy/status/1981760576591393203 [3] https://www.nvidia.com/en-gb/solutions/autonomous-vehicles/alpamayo/ https://www.nvidia.com/en-gb/solutions/autonomous-vehicles/a...

irishcoffee 9mo ago
> Language allows If a tree falls... Waymo, X, Nvidia. You fucking nailed unbiased.
- red75prime 9mo ago
  [0] if you want something more academic. What's your gripe with language, anyway? [0] https://arxiv.org/abs/2506.24044 https://arxiv.org/abs/2506.24044
  - irishcoffee 9mo ago
    Language is a construct. > allow[s] higher-level and longer-term planning and better generalization than purely vision-action model People do that part. Languages don't plan, they don't think. They don't _do_ anything at all.
    - red75prime 9mo ago
      Sure. Language just seems to structure a general learning system in a way that allows it to do all those things.
      - irishcoffee 9mo ago
        > Sure. Language just seems to structure a general learning system in a way that allows it to do all those things. That's like saying python structures a general system. Python does nothing at all. People use python to create constructs. We've covered this. :)
        red75prime 9mo ago
        Python is not a natural language. A natural language communicates things that are not here and now (essentially everything that occurs naturally). Moreover, language can convey abstractions that exist because of language itself.