4 ms·
With all the hype about AI this year, does anyone know whether it's translating in any meaningful sense into self driving? Can they use transformers? If so, i
by RobinL 3y ago
With all the hype about AI this year, does anyone know whether it's translating in any meaningful sense into self driving? Can they use transformers? If so, is there a step change in performance? Has this already happened?
- mkaic 3y agoAlready happened and still actively happening! In Tesla's latest annual AI day presentation they gave some insights into their training procedures and architecture choices. Lots of transformers, lots of bleeding-edge stuff.
- boulos 3y agoYep! Our research team publishes a lot of work (waymo.com/research). If you're interested in Transformers and attention in particular, the excellently named Wayformer [1] paper is pretty easy to follow and SWFormer is impressive on a lot of levels [2]. The main challenge for autonomous vehicles has been (large) multi-modal inputs, while delivering real-time inference performance on the road. Many of the large-language model things you see produce cool results, but would be much too slow or expensive for a real-time, safety-critical application. [1] https://arxiv.org/abs/2207.05844 https://arxiv.org/abs/2207.05844 [2] https://arxiv.org/abs/2210.07372 https://arxiv.org/abs/2210.07372