18 ms·
The monorail video is jaw-dropping. Yes. Pause the video and look at the car's screen. There's no indication on screen of the columns. A car on the other side
by Animats 5y ago
The monorail video is jaw-dropping.
Yes. Pause the video and look at the car's screen. There's no indication on screen of the columns. A car on the other side of the row of columns is recognized, but not the columns. It's clear that Tesla has a special-purpose recognizer for "car".
The columns are a solid obstacle almost impinging into the road, one that doesn't look like a car. That's the standard Tesla fail. Most high-speed Tesla autopilot collisions have involved something that sticks out into a lane - fire truck, street sweeper, construction barrier - but didn't look like the rear end of a car.
As I've been saying for years now, the first job is to determine that the road ahead is flat enough to drive on. Then decide where you want to drive. I did the DARPA Grand Challenge 16 years ago, which was off-road, so that was the first problem to solve. Tesla has lane-following and smart cruise control, like other automakers, to which they've added some hacks to create the illusion of self-driving. But they just don't have the "verify road ahead is flat" technology.
Waymo does, and gets into far less trouble.
There's no fundamental reason LIDAR units have to be expensive. There are several approaches to flash/solid state LIDAR which could become cheap. They require custom ICs with unusual processes (InGaAs) that are very expensive when you make 10 of them, and not so bad at quantity 10,000,000. The mechanically scanned LIDAR units are now smaller and less expensive.
- BugsJustFindMe 5y ago> As I've been saying for years now, the first job is to determine that the road ahead is flat enough to drive on. Then decide where you want to drive. I did the DARPA Grand Challenge 16 years ago, which was off-road, so that was the first problem to solve. Tesla has lane-following and smart cruise control, like other automakers, to which they've added some hacks to create the illusion of self-driving. But they just don't have the "verify road ahead is flat" technology. This matches my perception as well and it continues to blow my mind. Like it just seems like it would require full-on incompetence to use only specific pedestrian/car/sign/lane classifiers rather than splitting the world first into ground/obstacle by reconstructing geometry and then assigning relative velocity, acceleration, and curvature to coherent obstacle segments irrespective of their identification. But the videos always make it look like this is exactly what's happening. And worse it always appears to be happening on an instantaneous frame-by-frame basis with things flickering in and out of existence as if "thing there" and "nothing there" are somehow equally safe guesses.
- fnoof 5y agoThe flickering is concerning. Kind of suggests their NN hasn’t learned basic object persistence yet.
- BugsJustFindMe 5y agoThat's the thing. The software shouldn't have to "learn" fundamental basic real world shit like that. We KNOW that things don't just flicker in and out of existence. The system should be built on that premise from the start.
- soco 5y agoOh but that's what basically every gps software is doing - one moment you're slowly trailing on the highway, the other you're placed on the bridge above.
- Doxin 5y agoMost GPS software is smart enough to not flicker between the highway and the bridge repeatedly though. It's not like this category of problems is a wholly new thing. The car needing to switch lanes twice a second like in one of those videos is fairly unlikely, so if the ML is spitting out that it should, there probably ought to be a layer on top of that that's interpreting the ML output that can take the decision to pick one. Picking the wrong lane is less wrong than being indecisive about it.
- soco 5y agoI don't know about "most gps software" but I have a Garmin doing that and Google Maps does the same. So in my experience it's 100%. Now if such well established software products didn't figure out such basic stuff, either we're calling it wrongly "basic" (and it's a difficult problem) or the responsible factors just don't bother. The major difference is though, while gps navigation can do with frequent recalculations, realtime obstacle avoidance less so.
- 5y ago
- CyanLite2 5y agoLIDAR cost is coming down, but Tesla has almost no margins on cars. So adding a $500 part per car for LIDAR is out of the question. Even the cheap radar parts were removed from production going forward. However, it's good to see other automakers like Volvo going the LIDAR route on their 2022 electric models and are offering Level3 autonomous driving.
- Invictus0 5y agoTesla's Full Self Driving package was between 8 and 10,000 dollars per vehicle. That should cover it.
- CyanLite2 5y agoThe hardware suite is the same on every car nowadays. They want FSD to be a downloadable app like a subscription. Which means you would have to put LIDAR on every car even if it didn't convert to FSD. Also, Elon has gone on Twitter rants several times before against LIDAR. That horse has already left the stable and it ain't coming back.
- sbierwagen 5y ago>They want FSD to be a downloadable app like a subscription. Well that's just too bad. While I'm sure it would be inconvenient to their business plan, it remains the case that they're charging ten grand for that software patch, and have no possible argument relating to margin.
- Method-X 5y agoTesla’s margin on the Model 3 is 35%: https://thenextavenue.com/2020/06/10/teslas-model-3-profit-margin-is-35-and-it-can-double/ https://thenextavenue.com/2020/06/10/teslas-model-3-profit-m...
- CyanLite2 5y agoIt's not that high once you strip out the bitcoin gains and regulatory credits. https://archive.is/WAvau https://archive.is/WAvau
- spywaregorilla 5y agoWould the screen show the column if functioning correctly? I don't know this ui.
- nexuist 5y agoIt's possible they have no classifier for "monorail column" so I don't think anything would show up even if it recognized an obstacle was in the way.
- deleted 5y ago[deleted]
- spywaregorilla 5y agoI would imagine having a classifier for something so specific would be detrimental. I have no horse in this race, but I questioned how extreme the car's movements would have been without intervention. The guy yells as if the car is about to crash itself, but... idk, it didn't seem obvious to me that the car was actually going to do that. Does the UI actually show that it was trying to?
- heavyset_go 5y agoIt's scary that objects that weren't classified by ImageNet, or whatever, can cause self-driving cars to attempt to hit them at full speed.
- nexuist 5y agoI agree, and LIDAR would be the obvious best choice here. For whatever reasons the Autopilot team is choosing to go down the route of mimicking human driving, which means trying to replicate the pipeline of human eye to brain-object recognition. To that end, it's not unlikely that a human eye could mis-classify something on the road and ram a car into it at full speed. In fact, it probably happens every day.