5 ms·
What a crazy edge case. I wonder why it thinks an object that is not actually 'moving' (i.e. getting closer) is a traffic light.
by ezekg 5y ago
What a crazy edge case. I wonder why it thinks an object that is not actually 'moving' (i.e. getting closer) is a traffic light.
- version_five 5y agoYou highlight the big challenge with computer vision and other computerized identification of things, regardless of the underlying technology. There is no "mental model" of what makes sense against which to check observations. There can be coded rules, but if something passes them, there is no extra sanity check like a person would do. Put another way, models have no common sense, and we don't really have a meaningful way to give it to them. This is going to remain a problem for self driving cars and is a big part of the reason why they have not lived up to expectations.
- aabhay 5y agoHumans use stereo vision to overcome things like this. I think some kind of stereoscopic strategy would be a feasible strategy, no? Why revert to the age-old argument of "common sense"?
- patch_cable 5y agoI have one eye and have no problem not making these kinds of mistakes.
- nyx 5y agoHumans have more than just stereo vision sensors. Like GP said, we also have robust schemata, seeded by biology and improved over our entire lives, that allow us to make sense of the things we see. These heuristics are trivial for us to access, but relatively difficult to describe and implement in a software system. That's what "common sense" means in this context.
- clon 5y agoStereo vision is overrated. One of my buddies is a pilot with 1 eye (since birth) and around 11 thousand landings. Top of his game. There is more to depth perception than stereo vision for sure
- jazzyjackson 5y agoWe have a lens that has to flex to bring far away objects into focus, so I figure that can give us some feedback.
- wizzwizz4 5y agoFor sufficiently distant objects, this is completely irrelevant. This lets us roughly gauge the reciprocal of distance.
- blakesterz 5y agoFunny, when I saw that I thought how did they miss this one? It's the moon, how is it possible no one has driven a Tesla at the right time in the right direction to have picked up the moon? The moon is out quite often. It doesn't seem like that much of an edge case to me, though I could be wrong.
- jazzyjackson 5y agoCalifornians mostly drive north and south, so facing the moon head on would be rare xD
- Retric 5y agoThe exact situation with the moons coloration changed by atmospheric conditions and being in just the right location over a long straight road to trigger this on a long stretch of straight road is probably quite rare. The software eventually does reject it as not a yellow light, only to change it’s mind back to the moon. I am wondering if this relates to the image classification system starting over from scratch regularly for some reason.
- dingaling 5y agoA friend has a 2018 Honda with auto-dipping headlights, it mistakes a near-full Moon low to the horizon as an oncoming car and switches the headlights to low-beam.
- jazzyjackson 5y agoTo be fair to the Honda, what do you need high beams for when the full moon is out?
- walrus01 5y agoThe real world is full of 'edge cases' that humans can deal with through their intuition and understanding of context. Humans are unlikely to mistake a yellow-ish moon for a yellow traffic light unless very intoxicated. I'd like to see a Tesla on full autonomous autopilot take a drive in Calgary or Edmonton a few days after a heavy snow, when it's been mostly plowed but the lines are missing from the roads, all the lines at the side of the road are covered in snow, etc.
- Retric 5y agoAt level 3 they just reject things back to the driver if they can’t see road markings. Longer term GPS makes that an easier problem for self driving cars than bad weather. The post blizzard random trails through deep snow seem like a more difficult challenge, largely because it’s so rare.
- jvm_ 5y agoLanes in heavy snow covered roads are more of a suggestion. You can either drive on the bare 'wagon tracks' of road, or on the proper lane (that you can't even see) with 6-12 inches of snow on them. Often when driving like this, you see a glimpse of the middle-yellow line inside one of the wagon tracks, and you realize that you're actually driving in part of the other lane. Fortunately the opposing traffic's wagon tracks are also shifted so that they're driving partially on the shoulder. A GPS guided car would make a mess of the wagon track pattern that all the humans decided to just go with.
- Retric 5y agoI am not talking 6-12 inches, when it’s 4+ feet of snow even pickup trucks need to stick to the valley’s which rarely have much to do with traffic lanes.