11 ms·
Camera crushes Lidar, claims startup
- alphabetting 3y agoThe most performant AVs right now aren't using solely lidar. They have cameras and many other monitors in their sensor suites.
- hirundo 3y agoIt's extraordinary that the article mentions Waymo and Cruise in this context but not Tesla.
- deleted 3y ago[deleted]
- Humboldtsnee 3y ago[dead]
- adrr 3y agoTesla doesn’t have autonomous vehicles. It has level 2 vehicles. Waymo and cruise have level 4 vehicles.
- ramesh31 3y ago>Waymo and cruise have level 4 vehicles. In a single small extremely constrained geofenced area using vehicles with hundreds of thousands of dollars worth of sensors each. Those companies are complete dead ends. They are not even remotely solving for the general case.
- adrr 3y agoGeofenced is the definition of level 4. Tesla doesn’t have a level 3 car on the market.
- ramesh31 3y ago>Geofenced is the definition of level 4. Tesla doesn’t have a level 3 car on the market. And levels 3/4 are useless, better served by public transit. There's a reason the Japanese/Korean manufacturers are skipping them. You either have really good level 2 (i.e. LKAS+ACC), or you go to full level 5. And Waymo/Cruise will never solve for level 5 with their approach. Tesla (and Comma) are at least working on the general solution to it.
- Humboldtsnee 3y ago[dead]
- adrr 3y agoYou can take a public transit to the airport. I’ll take a Waymo taxi.
- mrguyorama 3y agoIs this supposed to be an argument? Some sort of elitism about public transit?
- enragedcacti 3y agoAnd levels 3/4 are useless, better served by public transit. Level 4 where the geofence is "all major cities and highways" would be immensely useful. > There's a reason the Japanese/Korean manufacturers are skipping them. https://www.caranddriver.com/news/a35729591/honda-legend-level-3-autonomy-leases-japan/ https://www.caranddriver.com/news/a35729591/honda-legend-lev... https://canada.autonews.com/technology/hyundai-very-close-achieving-level-3-autonomy https://canada.autonews.com/technology/hyundai-very-close-ac...
- adrr 3y agoToyota partnered with Pony.ai and have a fleet of level 4 taxis operating in all major cities(eg: Beijing, Shanghai and Shenzhen) in China. Honda has level 3 self driving cars on the market in Japan that you can buy today. Kia is working on a level 3 car and also announced level 4 taxi plans. Hyundai also has plans to add level 3 functionality to their cars.
- deleted 3y ago[deleted]
- konschubert 3y agoHow much does it cost to pay a human driver for 10 years?
- Fricken 3y agoIt seems Tesla is finally starting to get serious about L4 autonomy, but they don't have much to show for it yet. What's extraordinary is how many people have fallen for Elon's bullshit and remain committed to it in spite of it being obvious bullshit. In any case, many journalists are still trying to spin it as cameras vs lidar when it's really single modality vision systems with no redundancy versus multi-modal vision systems that conventionally include camera as well as lidar. Various Lidar startups have also made inroads in deriving vision from laser range finding technology. It's hard to speculate on what will win in the end, but nitpicking these things is a form of bike shedding. Ultimately it comes down to the software, which is a much bigger problem and not as straightforward to wrap one's brain around.
- jeffreygoesto 3y agoI assume the downvotes are about mentioning that one person that gets mentioned a lot? Factually this post is pretty accurate IMHO. As a human you can almost always extract "this could have been seen" from fusion sensor data. That does not mean the computer can (some of this also vibes from you judging post mortem and typically having additional information about the scene). Neither hand made nor trained classifiers master the "long tail" that is needed for L4. This does not change with some percent improvement of one sensor.
- vm 3y agoThis article doesn’t address when cameras are blocked, which is the obvious issue with camera-only self driving. Teslas have crashed when cameras were blinded by the sun. Now throw in snow, rain, dust… Is that solvable with lots of cameras and different types? …Does it need to be solved? Maybe the bigger question - anyone know the status of low cost lidar? Dozens of startups and larger companies were working on it 10 years ago, yet Lidar still costs “thousands” according to the article
- deeviant 3y ago> Maybe the bigger question - anyone know the status of low cost lidar? "Solid state" lidars would fit the fit bill for likely low cost lidar. They are probably 3-4 years out, and have been for the last 10 years.
- coolspot 3y agoiPhone 13 Pro has solid state LiDAR.
- nucleardog 3y agoIt was introduced in the 12 Pro models released in 2020.
- tanjtanjtanj 3y agoThere's something bizarre going on with lidar manufacturing/pricing. When I was looking into it for a specific application it was much cheaper to buy entire made-in-china products containing the exact lidar module than it is to buy the part separately, even at bulk pricing.
- deleted 3y ago[deleted]
- krisoft 3y agoThis is very common with all kind of components. There are economies of scale your vendor can achieve when they sell someone a million of the same thing. Also the company buying a milion of the same thing is going to pay the vendor a significant sum, even if they get all kind of discounts, and that puts them at a much better negotiating position than you buying a single one. Hobbyist buying a few units of a component, even if they are buying it with a significant margin, will net the producer peanuts. So not surprising they don’t worry much about serving them that market.
- Jemm 3y agoHasn't this already been settled after Tesla's claim?
- sublinear 3y ago> To see how their system performed in these situations, NoDar conducted a series of tests on a remote airstrip in Maine with almost zero light pollution. Isn't this the opposite of realistic? > In broad daylight, NoDar’s setup generated 40 million 3D data points per second compared to the lidar’s 600,000. In extremely heavy rain the number of valid data points dropped by only around 30 percent, while for lidar the drop was roughly 60 percent. And in fog with visibility of roughly 45 meters they found that 70 percent of their distance measurements were still accurate, compared to just 20 percent for lidar. These results sound very cherry picked.
- porphyra 3y agoYeah and having 600k high quality lidar points is better than having 40 million noisy stereo points. Honestly their depth map is so full of holes and artifacts, despite the fact that a depth map is the easiest way to hide poor quality (since range inaccuracies only manifest as subtle hue changes). Also not sure why they picked a 600k points per second lidar instead of a 3 million point per second one like an Ouster 128 beam one.
- joshvm 3y ago> despite the fact that a depth map is the easiest way to hide poor quality I did my PhD on stereo and LIDAR; also in industry building these things. This is something that really annoyed us about camera companies selling stereo systems: you cannot tell anything from a colormapped depth plot. It doesn't matter if it's grayscale or jet or a nice perceptually uniform one. Zed are really bad for this in their promo material. Small errors might be really significant for reconstruction, but depth maps make it easy to hide errors, fuzzy bits, holes, discontinuities etc. Really you want to test against a known calibration object at a distance and present the reconstruction error, show the 3D reconstruction top-down (or in a way which lets you see how much depth variation there is) or compare to a simultaneous LIDAR capture which might be sparse but will be more accurate (absolute) at distance.
- porphyra 3y ago
- CharlesW 3y ago"Camera crushes lidar" is marketing spin, because different types of sensors "win" for different scenarios. You really want a sensor fusion strategy for devices making life-or-death decisions on your behalf.
- mensetmanusman 3y agoYou really want what works best given the ms time budget in the context of your on-board compute.
- mynameisvlad 3y agoIf it’s a life or death decision, you should opt for the best strategy, not the cheapest.
- IntToDouble 3y agoCheapest being humans.
- geysersam 3y agoNot necessarily. Maybe currently, but perhaps not in the future.
- spdif899 3y agoPerson you're replying to is talking about time budget offered by your computer, not monetary budget. Regardless everything is about optimization - the "best" option will almost always be so costly that no consumer will be able to afford it.
- NovemberWhiskey 3y agoIf the technology (i.e. self-driving) cannot be delivered safely at an affordable cost, then probably it shouldn't be delivered at all then, no?
- ChrisMarshallNY 3y agoSounds cool. But these days, I’ve learned to wait for a working commercial prototype, before cheering.
- 2rsf 3y agoClickbait as usual, it is one company's own claim.
- snarkyturtle 3y agoit'll also crush the kids they run over
- fjfaase 3y agoIt is known that in neurological vision there is are also top-down pathways, where later stage processing influences early stage processing. Especially in poor conditions, the interpretation of images is based on an already established 3D model of the environment and information about ones own direction of movement. It is nice that the system can generate 40 million 3D data points per second, but those point still need to be processed (and interpreted) in later stage processing.
- fjfaase 3y agoThe cameras being 1.2m apart is nice for accurate triangulation at a larger distance, but in a crowded location with obstancles near the road, it could lead to substantial blind areas at closer distances. I also guess that in the dark, reflections of lights in puddles on the road could lead to a stark reduction of valid 3D points or even mismatches.
- ck2 3y agoSo mud and dirt and dust and oil and antifreeze and all kinds of garbage spray on the roads covers all parts of a car. Some people never wash their car if they don't want to. What happens with these sensors? Can they detect physical interference? Will they refuse to let an assist mode of any kind activate if there is a malfunctioning sensor? What kind of self-diagnostic do they run, how often and how fail-proof is it?
- agab 3y agoVolvo has had this solved for ages. Bring them back! https://imgur.io/gallery/C3Kww https://imgur.io/gallery/C3Kww
- mrguyorama 3y agoAnd when those break down and the owner doesn't fix it? Self driving cars will require regular and stringent inspections of functionality, otherwise it's a time bomb.
- TillE 3y agoPrivate individuals owning self-driving vehicles won't really be a thing in the longer term, it doesn't make economic sense. There are countless advantages to having a company or local government run and maintain a fleet.
- nomel 3y ago> it doesn't make economic sense It does, in the other parts of the world, where there are cars being made that exist outside of the luxury market. You can still get a Nissan Versa for $16k. Adjusted for inflation, that's only $7k, in 1990, which is cheaper than a Ford Escort from 1990, and 35% more horsepower. The problem is that people's standards are ridiculous.
- nomel 3y agoThis seems fairly trivial. * Since safety regulations will be required for this, include a built in self test, with a refusal to engage self driving until the test/sensors are deemed safe enough. * Race cars use a spool of plastic film over their cameras, so a clean window is always ready. That's on option. There's the standard wiper. If you look around next time you're out, you'll see that most cars are very clean. So, I think this would be a non issue for most people. * Since the self test requirements may become more stringent over the years, cars that can't comply with the latest requirements can have an anual/semi annual verification, like we do now for emissions of older cars. Maybe as part of the standard, thresholds for the self test will need to be adjustable, to keep them in the "safe" range, and trigger earlier checks/cleaning. * You have to compare all of this to having a human behind the wheel.
- steno132 3y ago[flagged]
- squokko 3y agoI thought a deranged camera had crushed a LIDAR and then claimed the life of a startup.
- GabeIsko 3y agoWould solid state Lidar really be that much more expensive than a CMOS camera if it were manufactured at scale?
- 4ndrewl 3y agoI read the title to mean "a camera crushed a lidar sensor which caused a startup to go into administration"
- Tagbert 3y agoand scissors cut paper
- intrasight 3y agoIf time-of-flight sensing made sense, we would have evolved that over millions of years - oh wait...
- Vecr 3y agoI'm actually interested in this, are you claiming humans do time of flight measurements?
- intrasight 3y agoMy "we" was really animals in general, where there are several examples: bats, dolphins. But I have seen some academic papers on human echolocation over the years.
- Vecr 3y agoOh, I thought you meant time of flight for light, e.g. lidar. That would be very surprising.
- Hippocrates 3y agoI highly recommend listening to this podcast episode. Lex Friedman interviews Andrej Karpathy (former director of AI at Tesla): https://podcasts.apple.com/us/podcast/lex-fridman-podcast/id1434243584?i=1000584342757 https://podcasts.apple.com/us/podcast/lex-fridman-podcast/id... 1:32:39 Andrej explains why Tesla removed Radar and relies on vision. Part of it is that other sensors bloat and complicate the software needed to interpret data coming in. What if they get conflicting signals? There may be calibration or manufacturing inconsistency to account for. You need to normalize that in your software and the entropy quickly gets out of control. I find this explanation very compelling and feel like vision is the more "necessary" sensor anyway. After all, roadways are designed to be navigated using vision.
- bloodyplonker22 3y agoHe "forgets" to make a point of the number one reason they don't use lidar: cost.
- yreg 3y agoFor lidar surely, but what about the ultra sonic sensors?
- callalex 3y agoIf something is required for the core functioning of your product, that thing is not “bloat”. That’s like saying “It’s really hard to do security and authorization for this server I’m setting up, I’ll just call it bloat and leave everything open.”
- pedalpete 3y agoI'd be curious to understand why the they think the technology would work in fog. The article suggests it does, but the science behind how that worked wasn't explained (or I didn't get it). Does anyone understand this? The problem with fog as I understand it is that it defuses light, washing out vision. My understanding is that Lidar does not bounce off fog, or at least to the same degree. Is my understanding there correct?
- tb_technical 3y ago¿Por qué no los dos?
- iamleppert 3y agoLong baseline stereo matching has a trade off of poor depth resolution in short ranges and requires wide angle lenses which result in an uneven distribution of data after correcting for distortion. The wider the lens, the more distortion increasing as you move away from the center of the lens as pixels are no longer square; you also need higher and higher resolution sensor to get good matches around the edges. This makes it very hard and computationally expensive because you need to search progressively larger areas of the image to do matching to get the same FOV at longer range. Large baseline also is more likely to suffer from occlusion (even self-occlusion) by objects in the foreground resulting in holes in the depth map. In addition to being harder to keep the cameras rigid between calibrations (but I guess they figured this part out). Instead of a depth map like they show it would be much more useful if they instead show a map of the reprojection error of a flat calibration target at the minimum and maximum depth ranges. Even if they are not aiming for geometric accuracy it would give a much better idea of the actual performance of their system. The problem with these stereo camera companies is they get obsessed with maximizing certain metrics when the fact is there is a fine balance of trade offs to maintain that is highly specific to the desired application and even scene. Sure, you can increase the baseline and figure out how to mitigate calibration but that creates many more problems to solve that only become apparent when you try to apply it to some application. Anyone interested in long stereo baseline should check out this blog which has been around forever: https://www.elphel.com/blog/2017/09/long-range-multi-view-stereo-camera-with-4-sensors/ https://www.elphel.com/blog/2017/09/long-range-multi-view-st...
- deleted 3y ago[deleted]
- Andrey_Filippov 3y agoWe do it now with thermal images: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/11741625 https://image-ppubs.uspto.gov/dirsearch-public/print/downloa...
- mikewarot 3y agoIf you're going to deal with multiple cameras, why wouldn't you at least have a 4x4 array of cameras, with a spacing of at least 10 cm? You could deal with small object occlusion, and gain some redundancy.