6 ms·

Not sure I'd trust an autopilot based on crude visual odometry and segmentation that can only achieve a paltry 17 fps.

aeternum 7y ago
Not sure I'd trust humans since their crude visual systems lead to reaction times of over one second: https://www.researchgate.net/publication/233039156_Brake_Reaction_Times_and_Driver_Behavior_Analysis https://www.researchgate.net/publication/233039156_Brake_Rea... 17x faster is an impressive improvement
- Tiktaalik 7y ago
  "impressive improvement" over such a flawed and dangerous form of transportation that it yields one of the top causes of human death. Self driving cars is a case of doing the wrong thing better. I agree with the parent and there are better solutions out there.
- iamleppert 7y ago
  Human beings visual systems are far faster than once per second. Your reference is complete reaction time to both process visual information and decide on an appropriate action and actuate a control surface given a state model of the world. Your brain most certainly processes visual information faster than 17 fps doing novel segmentation and odometry.
  - aeternum 7y ago
    Tesla's system is also doing much more than simple segmentation and visual odometry. Tesla's latency around actuating the control surface is quite insignificant (a few ms) so I'd argue it is a fair comparison.
    - rootusrootus 7y ago
      Does it have the object permanence abilities of a six month old baby?
      - trca 7y ago
        In the "FSD Preview" update that came out around Christmas time, the car now shows a bunch of symbols on the road, and signs (aka stop signs) that it recognizes. They don't flicker at all, even while you're driving and a large truck obscures the car's vision of the sign / stoplight. So they likely have started to enable some form of temporal memory into the system so that it remembers what it has observed in the environment both frame-to-frame and overall.
        rootusrootus 7y ago
        That hasn't been my experience. The visualization only ever shows what I can see with my own eyes, and the cameras are in a very similar position. I've definitely watched traffic signals come and go, all while not moving an inch.
- rootusrootus 7y ago
  Human frame rate is more like 1000 fps physiologically, effectively 150 fps with perception.
- red75prime 7y ago
  If Tesla's autopilot has no notion of object permanence, then it's worse than 5 month old infant in some respects.
- andbberger 7y ago
  Really doesn't matter how fast it is if it doesn't work does it? Don't let all the impressive CNN results fool you, we are a long, long way from doing human level vision. There's a reason everyone else uses lidar...
mlindner 7y ago
These videos are quite old. The current system runs at 60 fps on all cameras. The old system was limited to a single camera at 17 fps because of the hardware processing requirements.

Not sure I'd trust humans since their crude visual systems lead to reaction times of over one second: https://www.researchgate.net/publication/233039156_Brake_Reaction_Times_and_Driver_Behavior_Analysis https://www.researchgate.net/publication/233039156_Brake_Rea... 17x faster is an impressive improvement

Tiktaalik 7y ago
"impressive improvement" over such a flawed and dangerous form of transportation that it yields one of the top causes of human death. Self driving cars is a case of doing the wrong thing better. I agree with the parent and there are better solutions out there.
iamleppert 7y ago
Human beings visual systems are far faster than once per second. Your reference is complete reaction time to both process visual information and decide on an appropriate action and actuate a control surface given a state model of the world. Your brain most certainly processes visual information faster than 17 fps doing novel segmentation and odometry.
- aeternum 7y ago
  Tesla's system is also doing much more than simple segmentation and visual odometry. Tesla's latency around actuating the control surface is quite insignificant (a few ms) so I'd argue it is a fair comparison.
  - rootusrootus 7y ago
    Does it have the object permanence abilities of a six month old baby?
    - trca 7y ago
      In the "FSD Preview" update that came out around Christmas time, the car now shows a bunch of symbols on the road, and signs (aka stop signs) that it recognizes. They don't flicker at all, even while you're driving and a large truck obscures the car's vision of the sign / stoplight. So they likely have started to enable some form of temporal memory into the system so that it remembers what it has observed in the environment both frame-to-frame and overall.
      - rootusrootus 7y ago
        That hasn't been my experience. The visualization only ever shows what I can see with my own eyes, and the cameras are in a very similar position. I've definitely watched traffic signals come and go, all while not moving an inch.
rootusrootus 7y ago
Human frame rate is more like 1000 fps physiologically, effectively 150 fps with perception.
red75prime 7y ago
If Tesla's autopilot has no notion of object permanence, then it's worse than 5 month old infant in some respects.
andbberger 7y ago
Really doesn't matter how fast it is if it doesn't work does it? Don't let all the impressive CNN results fool you, we are a long, long way from doing human level vision. There's a reason everyone else uses lidar...

mlindner 7y ago

These videos are quite old. The current system runs at 60 fps on all cameras. The old system was limited to a single camera at 17 fps because of the hardware processing requirements.