3 ms·
> Remember how some British researchers made a self driving car using an LLM? No? Do you mean actual, full self driving on normal roads in traffic?
by SahAssar 3y ago
> Remember how some British researchers made a self driving car using an LLM?
No? Do you mean actual, full self driving on normal roads in traffic?
- mrtksn 3y agoYes, IIRC they reason on the car actions using LLMs. They still use image processing but once you identify the objects in the scene, the LLM interprets and decides what to do with the car. I'm not sure which one was it though(Ghost Autonomy maybe?).
- SahAssar 3y agoDo you have a source? Because that actually, properly working would be headline global news and would value the company in the billions.
- mrtksn 3y agoIt was discussed here on HN, that's how I know about it. I found a few things when searched around but not sure which one was the one I recall. Anyway, here is a video from one: https://www.youtube.com/watch?v=C2rbym6bXM0 https://www.youtube.com/watch?v=C2rbym6bXM0 Here is a paper discussing something similar: https://arxiv.org/abs/2307.07162 https://arxiv.org/abs/2307.07162
- SahAssar 3y agoThe description for that video says > Ghost Autonomy’s MLLM-based capabilities are currently in development. These video and image examples show MLLM-based analysis of driving scenes captured from Ghost vehicles driving in both autonomous and conventional mode. MLLM-based reasoning is not yet being returned to the car to impact actual driving maneuvers. So the model discussed is not doing any driving whatsoever. This is not self-driving at any level.
- mrtksn 3y agoThen its not the one I remember maybe.