3 ms·
> Just taking noisy camera data and turning it into a de-noised picture. I think this is a huge simplification of the actual problem. Not only do you have to d
by tylerhou 6y ago
> Just taking noisy camera data and turning it into a de-noised picture.
I think this is a huge simplification of the actual problem. Not only do you have to denoise the data, you have to use the data to generate models of 3D objects in space. Maybe you could argue that exact 3D models are not necessary, but IMO any neural network that can drive at Level 4/5 needs to approximate 3D space in some layer.
This is incredibly difficult; we have an entire region of the brain dedicated to for this exact purpose (the visual cortex). This region has the benefit of millions of years of evolution. We also have the advantage that we can predict 3D models based on everyday experience; we don't know how to encode that knowledge into a neural network efficiently. That's not even mentioning the latency requirements that driving in the real world would impose on such a network.
- Dylan16807 6y agoYou have to do all that hard stuff with or without snow. The difficulty imposed by snowfall itself is just de-noising.