5 ms·
This is why you should use radar and/or lidar, not just cameras...
by verdverm 5y ago
This is why you should use radar and/or lidar, not just cameras...
- sabujp 5y agoare you saying obstacle avoidance is impossible with multiple cameras (yes probably not as robust)? Is it not possible to tell the difference between an image artifact / shadows and actual solid object?
- MBCook 5y agoThe problem with radar is it can’t see up high right? Just low to the ground where the unit is? Based on this video I’m not sure the radar would’ve had anything to catch. It seems like the plane hit the top of the car, not that the car hit the landing gear.
- darth_avocado 5y agoWithout even knowing how their internals work, I can guarantee that the bug in their software is that they don't check for height clearance, because it's not needed in 99.99% of the situations. However, I do think radar should have caught it, because radar has almost like a cone like view in front. If the car was far enough, the cone would've spotted the height.
- _moof 5y agoRadar can see wherever it's pointed. Point it up and it'll see up.
- MBCook 5y agoGiven. But I don’t think that’s where normal car radars are pointed and as far as I know no one has an aim-able radar in a car. They all point to look for a car dead ahead on the road. Not an ultra-low bridge (or landed jet).
- _moof 5y agoMaybe. I honestly don't know. But I can't help but wonder what's going to happen at a toll gate, at a railroad crossing with the arms down, after a storm and a branch is half-broken and suspended over the road, etc. Doubtful any of those things would have a radar return worth mentioning but if nothing is looking slightly up, folks are going to have a bad time.
- joshgachnang 5y agoSmart Summon does use radar. Last I checked it's disabled on vision-only Teslas. I wouldn't use until it uses the new FSD stack, because even with radar it is not good.
- opendomain 5y agoTesla has radar but it is disabled? why is that?
- atchoo 5y agoRemoved from newer models due to part shortages / cost reduction. The software function removed from models with the hardware for consistency / to give the false impression that it wasn't a useful sensor and that the cars are not going backwards in capability.
- panick21_ 5y agoBecause those radars are low results and lead to false positive. The achieved better results with camera only.
- harambae 5y agoSo with camera only how do you determine if a paper bag on the highway is empty or full of metal objects?
- cma 5y agoTesla bragged radar could bounce under the car ahead to react to the second car ahead stopping, even though the second ahead couldn't be seen. Removing radar was needed due to the electronic component shortage.
- panick21_ 5y agoMusk mentioned this on twitter a number of years before, but it turned to not to be that practical with those radars. That they were planning to remove radar was clear a while before but the electronic component shortage made it a higher priority problem.
- outworlder 5y agoHow well is a front-facing radar going to see a Vision Jet, considering it's higher up and mostly composites?
- peteradio 5y agoNeither of those two things seem relevant at first glace, I could be wrong. Why would lidar be impacted by composites? Why would lidar be impacted by object height? Presumably you'd have sensors on the nose of the vehicle.
- boboche 5y agoI was thinking the same way a year ago and telling my fanboy tesla friend how stupid it was removing lidars etc., but being open minded and always looking to be challenged, I started researching what they are doing and how they are doing it, watch their AI day video (its old in AI terms but gives a good insight), and I eventually got what they’ve meant when saying lidar introduces noise compared to what they are doing right now. TLDR is they convert photons into a multistereoscopic camera and reconstructing the brain’s behavior towards objects and motion…the way they transform the image data into high quality 3d point clouds is really mindblowing, people outside of the 3d ecosystem cannot fully appreciate that, and its kind of sad. The camera performance is like the newer starlight sensors in terms of seeing in the dark, and they seem to process from raw data. Essentially, once they crack all the quirks, I am now a firm beleiver that it will better than the average joe with limited angulars vision+rotating head vs. surround stereoscopic vision. Not saying I 100% agree with launching a beta program in the wild like this, but to their defense, given the current government driving paperwork and legislation to insane levels of unproductivity, innovators and challengers kinda have to play it out like that if they want to disrupt sectors (in the end) for the better. Not saying the end justifies the means, but I can understand the logic.
- boboche 5y agoWow lots of moderation hatred when writing a simple tsla comment ;)
- PragmaticPulp 5y ago> TLDR is they convert photons into a multistereoscopic camera and reconstructing the brain’s behavior towards objects and motion… I think maybe someone dazzled you with some excessive jargon. Extracting point clouds from stereoscopic cameras isn't a Tesla invention, even though they've invested a lot into trying to make theirs work. This is some computer vision 101 stuff, but nobody calls it "converting photons". > Essentially, once they crack all the quirks, I am now a firm beleiver Well obviously if they solve all of the problems then we'd all be believers too.
- moogly 5y ago
- sbuttgereit 5y agoSo if a human were driving the car, they would have crashed into the plane? Humans don't have radar or lidar.... and probably worse vision than the cameras on a Tesla have... but probably wouldn't have hit the plane. There may well be valid arguments for radar/lidar superiority over cameras, but the line of reasoning you're suggesting isn't in that category.
- serf 5y agohumans are mobile, with moving necks/torso/eyes/etc. I don't think anyone would argue that cameras couldn't do the same job if capable of realizing depth and re-assessing from different angles when confronted with ambiguity... but show me what a system like that would look like. A human that is parking somewhere ambiguously often gets out of their car to inspect the area with their binocular vision from multiple angles; this is common among trailer owners. The vision system on a vehicle is tasked with a harder problem in many ways -- it's trying to solve the ambiguity of the scene purely visually with mostly-stationary cameras and prior knowledge.
- Dylan16807 5y ago> moving necks/torso/eyes/etc > realizing depth and re-assessing from different angles A car with three or four widely spaced cameras can get way better visual information than a human can. (At least in the forward direction. Add more cameras for 360.) To the point that you could probably give the human a VR set tied into the cameras and have them do a better job because you can make the pillars transparent. (Might need a special VR set with extra-wide field of view.)
- sbuttgereit 5y agoThat's all fine and I don't necessarily take issue with what you're saying, but now we're talking about implementation details. > but show me what a system like that would look like. I'm guessing not so much more wacky as the lidar based cars I see driving through my neighborhood. The accident in the original link may well have been caused by an inadequate vision based system (I don't know), but just because an accident happened with a single vision implementation doesn't mean that somehow Lidar/Radar would necessarily be superior. That conclusion, tossed off by the original comment, is just wrong as it stands. > A human that is parking somewhere ambiguously often gets out of their car to inspect the area with their binocular vision from multiple angles; In most cases, but not always. I have an old friend that was completely blind in one eye: still legally licensed to drive and successfully navigated the environment better than a lidar/radar/artificial vision system still can. Even in bad weather conditions such as snow and rain (and night). Will that hold true over time? Hard to say, but I'd bet right now that the larger problem is processing the received information regardless of how the information was acquired. The problem with the original statement is that it reminded me of the line of reasoning that goes, "there are aspects of the world that science has no answer for, therefore God." or "there was an abnormally cold day in spring, therefore no global warming" Tesla hasn't implemented a sufficiently robust visual driving system to avoid running into parked airplanes, therefore Lidar/Radar. It simply doesn't follow. Much more is needed. Ultimately, to date, the only sufficient input for fully independent driving that we have is vision based. Lidar/Radar may ultimately be superior, but a vision based system is so far the only generally accepted method for driving... even if it is biological vision rather than computer vision.