It should be predictable difficulty though, right? What's the actual difficulty for a robot driver? Typically in residential driving it comes down to perception

It should be predictable difficulty though, right? What's the actual difficulty for a robot driver? Typically in residential driving it comes down to perception(/prediction) difficulty and planning difficulty.