4 ms·

I understand that you are being sarcastic, but I'll pretend that you're not ;) There was a video showing the pattern recognition layer of a car 'forget' about

I understand that you are being sarcastic, but I'll pretend that you're not ;) There was a video showing the pattern recognition layer of a car 'forget' about objects it had previously correctly identified. There clearly is room for improvement, and some level of concern is warranted, but it isn't as much of a big deal as it seems, because surely at the higher level objects are remembered. To draw an analogy with human cognition, humans also aren't consciously aware of all the objects in their field of view all the time, but that doesn't mean they forget their existence.

disgruntledphd2 6y ago
I'm honestly not. I've seen that video, and given my experience of vision models, am actually concerned that object permanance is not being focused on. > There clearly is room for improvement, and some level of concern is warranted, but it isn't as much of a big deal as it seems, because surely at the higher level objects are remembered. I would be very surprised if this were true. > To draw an analogy with human cognition, humans also aren't consciously aware of all the objects in their field of view all the time, but that doesn't mean they forget their existence. This is exactly object permanence, in that babies start looking in the right direction for objects that disappear. I assume that Waymo at least have some kind of model for this, but am not convinced that it's particularly effective. Personally, I think that self-driving will require a limited theory of mind model, and we are nowhere near that.
- GrantZvolsky 6y ago
  > I would be very surprised if this were true. At the very least there must be some kind of a trajectory model which implies that multiple observations of the same object are analyzed as a sequence. How would it work without object permanence? Would it just erase objects undetected in the current frame and pretend they never existed? I suspect you're too focused on the vision aspect of the vehicle control system.

disgruntledphd2 6y ago

I'm honestly not. I've seen that video, and given my experience of vision models, am actually concerned that object permanance is not being focused on. > There clearly is room for improvement, and some level of concern is warranted, but it isn't as much of a big deal as it seems, because surely at the higher level objects are remembered. I would be very surprised if this were true. > To draw an analogy with human cognition, humans also aren't consciously aware of all the objects in their field of view all the time, but that doesn't mean they forget their existence. This is exactly object permanence, in that babies start looking in the right direction for objects that disappear. I assume that Waymo at least have some kind of model for this, but am not convinced that it's particularly effective. Personally, I think that self-driving will require a limited theory of mind model, and we are nowhere near that.

GrantZvolsky 6y ago
> I would be very surprised if this were true. At the very least there must be some kind of a trajectory model which implies that multiple observations of the same object are analyzed as a sequence. How would it work without object permanence? Would it just erase objects undetected in the current frame and pretend they never existed? I suspect you're too focused on the vision aspect of the vehicle control system.