7 ms·
This is pretty much the experience I have with my dash cam, a Yi. In its recorded video, its automatic exposure control make it look like everything outside of
by walrus01 9y ago
This is pretty much the experience I have with my dash cam, a Yi. In its recorded video, its automatic exposure control make it look like everything outside of the headline cone is pitch black, but it is actually not. I have seen deer and possums by the side of the road, and debris etc, that did not show up when I later checked the video for the same period. There is enough spillover light from modern headlights that a human whose eyes are dilated and adjusted to dark conditions will see a pedestrian standing on the median, stepping off it, crossing the inner lane towards the car's current lane. More than enough time to begin to brake and possibly swerve. I have dodged animals in a situation similar to this.
- jeffmould 9y agoI compare it to the backup camera in my car. While close up at night it is good, if something or someone is a short distance away I can barely make them out. However, looking in my mirrors I can see them or at least make out that someone or something is there.
- mozumder 9y agoA camera can have pretty good dynamic range at night, but it needs a big sensor, a huge lens to operate with a fast shutter speed. In the video, you can already see the motion blur, indicating shutter speed is slower than what it needs to be to identify nearby objects in low light. Autonomous cars are never going to be viable. Just looking at the cost of high-end SLR sensors and lenses that you'd need to match human eye dynamic range, and you're already looking at an expensive setup, before we even get to things like 360-degree vision and IR/LIDAR/Hyperspectral imaging. And that's in addition to all the compute problems. Sorry Silicon Valley tech-bros, but it's a fantasy you're chasing that's never going to happen. The quicker we can end this scam industry, the better. People really need to be told "no". Probably better to chase after flying cars..
- jader201 9y agoI think you’re comparing object detection to high quality photography though. There are plenty of options that can detect objects at night. Even cheap infrared technology, I would think, would be sufficient for picking up moving objects at night.
- jakeogh 9y agoWetware is astonishing stuff. All the propaganda to anthropomorphize machines is showing here... cheap IR sensors are not the issue. AI is not intelligent and inanimate objects have no self. They should pivit to augmenting drivers, not attempting to drive for them. I would happily utilize a properly designed HUD (meaning I have source access) connected to a fast MerCad or bolometer array.
- mozumder 9y ago> Wetware is astonishing stuff. It really is. The eye can detect a single photon. Fingertips can detect 13nm bumps, smaller than a transistor on Coffee-lake CPUs. We're better off acknowledging machine limits to work on other problems instead.
- scoggs 9y agoSorry for lack of input or varied discussion but I just had to stop and say how goddamn friggin cool it would be to have bolometers hooked up to a smart HUD that didn't interfere with your vision of the road. Something really translucent that smartly blended it's color scheme as to not interfere with the coloration of signs and details beyond your view on the road / around the road. But you are right, though. I think augmenting drivers sounds like a great idea in the sense you talk about. The kind of augmenting drivers I don't want are those stupid headbands you'd wear that beep like crazy if your head starts tilting in a way that resembles falling asleep. If you are in danger of falling asleep at the wheel and need a device like that I think it's pretty obvious one should take a nap on the side of the road or in a free parking lot, haha. Hopefully if we do wind up headed in that direction the people inventing will have a similar way of thinking and inventing.
- mozumder 9y ago
- masklinn 9y ago> A camera can have pretty good dynamic range at night No. A camera's dynamic range is pretty much fixed. If you can capture low-light objects it means high-light objects are completely blown out.
- zip1234 9y agoThey could have 2 cameras--one for low light, one for high-light fairly cheaply.
- masklinn 9y ago1. A good start would have been to put a good camera in the first place because that one is absolute crap. 2. I'm not sure you can fix the exposure on "fairly cheap" dashcams. 3. "high-light" in night settings are likely much lower than standard daylight, let alone bright daylight. Though I guess you could have an auto-exposure dashcam standard and add a low-light one which is only active in low light conditions.
- imaginenore 9y agoNo. The dynamic range of the camera depends on the ISO. http://i.imgur.com/dhcr6YO.png http://i.imgur.com/dhcr6YO.png So the comment above you is correct. A larger sensor can shoot at a lower ISO in the same lighting conditions, because its noise levels are lower.
- Drdrdrq 9y agoWhich is the same as with our eyes. There are ways around that limitation.
- todd8 9y agoI've read (see [1]) that humans have a low-light ability that approximates ISO 60,000, a pretty large value and larger than simple video cameras provide. However, very high end pro/enthusiast SLR's go considerably higher, see this real-time astrophotography with the Sony a7s at ISO 409,600 (youtube video [2]). The same Sony will work great in full sunlight too. The Canon ME20F-SH is a video camera reaches ISO 4,000,000. This camera has a dynamic range of 12 stops and is available at B&H for $20,000. [4] Of course, this isn't exactly the challenge that cameras face when assessing a scene. The dynamic range happens within a single scene all at the same time. Wide dynamic range (WDR) is the term I've seen used in describing video cameras that can handle both bright and dim areas within the same scene. [1] http://lightartacademy.com/blog/tutorials/camera-vs-the-human-eye/ http://lightartacademy.com/blog/tutorials/camera-vs-the-huma... [2] https://www.youtube.com/watch?v=ZRzXgSMbBu0 https://www.youtube.com/watch?v=ZRzXgSMbBu0 [3] https://www.cambridgeincolour.com/tutorials/dynamic-range.htm https://www.cambridgeincolour.com/tutorials/dynamic-range.ht... [4] https://www.bhphotovideo.com/c/product/1187825-REG/canon_1002c002_me20f_sh_multi_purpose_camera.html?ap=y&c3api=1876%2C%7Bcreative%7D%2C%7Bkeyword%7D&gclid=EAIaIQobChMI2PGTiPuA2gIVwbXACh09XgorEAQYASABEgJxxvD_BwE https://www.bhphotovideo.com/c/product/1187825-REG/canon_100...
- Scoundreller 9y agoIR can help with that. Headlights are limited by the disincentive of blinding oncoming drivers... Now that I think about it, self driving cars may be paralyzed by other self driving cars running IR boosted headlights.
- dredmorbius 9y agoHDR can help with that. https://en.m.wikipedia.org/wiki/High_dynamic_range_imaging https://en.m.wikipedia.org/wiki/High_dynamic_range_imaging https://youtube.com/watch?v=gtTdiqDqHc8 https://youtube.com/watch?v=gtTdiqDqHc8
- eric_h 9y ago> I have seen deer and possums by the side of the road Both of those have eyes that act as reflectors and you can see their eyes well before you can actually see the whole animal. This[0] suggests that the total time required for a human to avoid an incident like this is 3.6s (at 35 mph, casual googling suggests the car was doing 40). Even if we add 1 second of extra time to deal with it I'm not sure that makes the cut. 0) http://www.visualexpert.com/Resources/pedestrian.html http://www.visualexpert.com/Resources/pedestrian.html
- walrus01 9y agoI know what you're talking about with the eyes, I spend a lot of time driving rural WA highways at night, but no. I have seen deer that had their heads facing the other way and were standing in the shoulder/ditch area. In conditions where i can definitely make out the shape of the deer and its location but the dash cam sensor misses it entirely. Your last paragraph is a valid calculation if this were a case of a person stepping directly off a curb into the lane of traffic. However, it appears that they were probably standing on the median looking to cross, then stepped off into the left-most lane of traffic, an empty lane, proceeded across that lane towards the lane in which the car was traveling. In this sort of situation human intuition will recognize that a person standing on the median of a high-speed highway is likely to do something unusual. Particularly when you observe the visual profile of, as media has reported, a homeless person who is using the bicycle with numerous plastic bags hanging off it to collect recycling.
- sundvor 9y agoDriver didn't see this person because the driver was occupied with smartphone, only occasionally glancing up. Also, has anyone here talked about the effect on the eyes of watching a (typically) bright white screen vs letting them adjust to the light of the night yet? This point deserves to be brought up. Perhaps the video was intentionally darkened to simulate this effect. :P
- mirimir 9y agoI wonder if the driver is liable.
- sundvor 9y agoYep that exposure control / sensor quality of the dash cam in the video was rubbish. My own Blackvues produce far, far better results than that. Just look at how nothing is illuminated by street lights, this clearly has the effect of making the poor rider appear "out of nowhere". Also agree it appeared driver was on smart phone most of the time, thus not in control of the vehicle, and had thus no business being on the road as these are systems UNDER TEST. If that's the best Uber can produce then they ought to hang their heads in shame. Unless it was doctored with... as I find it hard to believe they'd put such rubbish quality cameras in their trials.
- panarky 9y agoDo you trust Uber to provide all the data, or would they selectively produce data favorable to them? Do you trust Uber to provide unedited raw video, or would they process it to increase contrast, make it appear that nothing was visible in the dark areas of the frame, reduce the resolution, drop frames, etc.?
- sundvor 9y agoYep, exactly..
- sharkoz 9y agoIt's funny how the internal camera which shows how distracted the driver was has way better night vision than the external road camera...
- Piskvorrr 9y agoThe key here is contrast; plus a IR light at 2 feet works great, at 60 feet...not so much.
- usrusr 9y agoThe internal camera (let's be honest and call it the scapegoat camera, because that's the only practical use for human "safety drivers" when they are not permanently engaged) must take almost all its light from IR, because we don't see anything of the smartphone screen glare that the eye movement so clearly hints at.