3 ms·

This is as good of a demonstration of the big "common sense" gap that end-to-end computer vision approaches have as it is of adversarial examples. Even with an

This is as good of a demonstration of the big "common sense" gap that end-to-end computer vision approaches have as it is of adversarial examples. Even with an occluded speed limit sign, humans have strong priors on what a sensible speed limit would be based on a more general understanding of the environment (width of lanes, curvature of roads, visibility, road quality, frequency of law enforcement vehicles ;), etc.).

castratikron 7y ago
Wonder if the neural net could be trained to know the speed limit? "This scene doesn't look like the usual 85 mph zone..."
- marrone12 7y ago
  You likely could train it to learn about trends and certain contexts. But then you still have to think and enumerate all of these separate possibilities.
- fyfy18 7y ago
  Many cars now come with a database of speed limits and display it on the dashboard. Although this shouldn't be relied on for self driving, it could be used to double check. OSM data for types of roads and areas is pretty accurate too, so you could use that ('an 85mph speed limit for a single lane within a residential area doesn't sound correct'). This doesn't need AI, it just needs someone with common sense to come up with a few basic rules about speed limits. If there is some doubt you could prompt the driver to confirm the speed limit change, and use that to build up a database of real world data. It sounds like the Tesla is just using what the camera sees - which is bad if true. Admittedly this was tested on a race track, so maybe there is no data saying otherwise (or even the opposite).
dr_hooo 7y ago
I don't think that this in particular is really a good example of this gap. It feels more like a sloppy implementation. Just like humans, an autopilot has multiple sources available for guessing what an appropriate speed would be. Simply including information from a map application should be enough to prevent these kind of mistakes/hacks. Now things like children playing on the side of the road certainly seem more difficult to handle..

castratikron 7y ago

Wonder if the neural net could be trained to know the speed limit? "This scene doesn't look like the usual 85 mph zone..."

marrone12 7y ago
You likely could train it to learn about trends and certain contexts. But then you still have to think and enumerate all of these separate possibilities.
fyfy18 7y ago
Many cars now come with a database of speed limits and display it on the dashboard. Although this shouldn't be relied on for self driving, it could be used to double check. OSM data for types of roads and areas is pretty accurate too, so you could use that ('an 85mph speed limit for a single lane within a residential area doesn't sound correct'). This doesn't need AI, it just needs someone with common sense to come up with a few basic rules about speed limits. If there is some doubt you could prompt the driver to confirm the speed limit change, and use that to build up a database of real world data. It sounds like the Tesla is just using what the camera sees - which is bad if true. Admittedly this was tested on a race track, so maybe there is no data saying otherwise (or even the opposite).

dr_hooo 7y ago

I don't think that this in particular is really a good example of this gap. It feels more like a sloppy implementation. Just like humans, an autopilot has multiple sources available for guessing what an appropriate speed would be. Simply including information from a map application should be enough to prevent these kind of mistakes/hacks. Now things like children playing on the side of the road certainly seem more difficult to handle..