> As far as I know, self-driving cars don't learn to drive better in real time. Instead the data is collected and used to improve the software. There might be f

> As far as I know, self-driving cars don't learn to drive better in real time. Instead the data is collected and used to improve the software. There might be frequent software releases (perhaps even every day) but this isn't quite the same thing. Most self-driving cars probably use some variant of local search[1]. In this case it probably doesn't matter if the agent learns offline or online. [1] https://en.m.wikipedia.org/wiki/Local_search_(optimization) https://en.m.wikipedia.org/wiki/Local_search_(optimization)