5 ms·
Good analogy about discovery of Pharma molecules. It’s really fun to think about the fact that Tesla has more than enough data to unlock autonomous vehicles, b
by mensetmanusman 6y ago
Good analogy about discovery of Pharma molecules.
It’s really fun to think about the fact that Tesla has more than enough data to unlock autonomous vehicles, but all that is missing is the correct AI architecture to get it working...
Who will figure out how to code that? Will it be a breakthrough, or can sub-optimal architectures eventually reach equilibrium with 10x or 100x the amount of time/data processing.
- antipaul 6y agoPerhaps. It seems it’s still an open question whether AI is just about memorizing your data, or can it actually make reliable decisions during previously unseen scenarios. Have we already observed, or collected, all that is possible in the “driving” world?
- ipsum2 6y agoMost self-driving companies use simulations to see how the model performs in unseen scenarios.
- maxbond 6y agoI'm sure that's tremendously helpful but isn't exactly an antidote, is it? You can't really simulate an unforeseen situation. If you can simulate it accurately - then you've foreseen it, and are thus able to account for all relevant variables. If you are randomly generating scenarios, something like fuzz testing or property testing, then I am sure you will discover bugs before they hit production, but you can't be sure you're simulating it accurately. For example, maybe when your car is T-boned while climbing a steep hill, the suspension behaves in a way you didn't expect and which isn't replicated by your simulation. Or maybe you're sent a batch of decals with bad adhesive, and in the hot sun the begin to slip down the windshield until they end up obscuring or otherwise interfering with a sensor. The only simulation that can account for every variable, regardless of whether you've anticipated it, is reality.
- KorfmannArno 6y agoI've yet to see an "AI" that is not just memorizing data.
- KorfmannArno 6y agoBut then again, how does something like the following work? https://twitter.com/GoogleAI/status/1293970520753369088 https://twitter.com/GoogleAI/status/1293970520753369088 Any idea how it could be fooled?
- antipaul 6y agoVia a fancy “adversarial” patch https://www.theverge.com/2019/4/23/18512472/fool-ai-surveillance-adversarial-example-yolov2-person-detection https://www.theverge.com/2019/4/23/18512472/fool-ai-surveill...
- nl 6y agoWhat do you mean by "fooled"? I'm very familiar with the BlazeFace and FaceMesh models (which are related to this in Google's MediaPipe framework). They have weaknesses - they aren't designed for running upside down for example, so if they get data that is that way oriented they will tend to fail. They aren't designed for "life" detection, so you can show printed pictures of a face and it will detected it. But they give you confidence scores etc, so if you give it something like a caricature of a face it will return reasonable confidence numbers indicating it isn't as sure of its predictions.
- nl 6y agoThen you haven't really looked. Most credible machine learning systems work well on unseen data, which by definition isn't memorizing.
- KorfmannArno 6y agoCan you link an example you find to generalize particularly well?
- nl 6y ago> It seems it’s still an open question whether AI is just about memorizing your data, No - it's not at all, and this is a well understood problem in building machine learning systems. There are some cases where this occurs but usually this is just overfitting. Good AI systems generalize well on unseen data.
- nl 6y agoTo the downvoters, I give you AlphaZero. Not only is every game of Go it plays and wins brand new (so no memorisation), the same system learnt to play Chess without knowing the rules, and plays in a "style .. unlike any traditional chess engine" https://deepmind.com/blog/article/alphazero-shedding-new-light-grand-games-chess-shogi-and-go https://deepmind.com/blog/article/alphazero-shedding-new-lig...
- rokobobo 6y agoI'm sorry, but is that true, that Tesla has enough data to unlock autonomous vehicles? My experience is that until you get an ML model to do X, you never know if you have enough data to train it to do X. Or is that just your opinion, that they don't need more data?
- mdorazio 6y ago> Tesla has more than enough data to unlock autonomous vehicles Many people in the automotive industry, myself included, disagree with this statement pretty strongly. Driving data quantity is not equivalent to quality and they are severely lacking in advanced sensor data.
- mensetmanusman 6y agoI don’t know, the existence proof is that it takes a 16 year old a few days of driving before they get it well enough...
- jointpdf 6y agoSo is the claim by Elon Musk that current iterations of Tesla vehicles have all of the sensors and compute power needed to be fully autonomous (Level 4+ I guess?) in the future, via software updates only, a specious one?
- nl 6y agoIt's hard to be absolutist on the response to that: anything is possible, and humans can drive without LIDAR. But at the moment it seems a strange position to take: we know LIDAR data is useful in many circumstances, and we know it can solve a number of the hard parts of computer vision.
- sbierwagen 6y agoMusk also said he was taking Tesla private at $420 a share, funding secured. He says a lot of things.
- nmca 6y agoI'm likely biased because I spend some of my time doing perception research, but I find the "advanced sensors are necessary" argument so odd. We have clear evidence from humans that you don't need them. I expect we'll be doing this sort of thing [0] in toy dynamic scenes from monocular vision in ~1year, and in real-time on city scenes in ~2. Perception-wise, what more do you need? Planning and control seem much harder, but that's not a sensing problem. [0] https://nerf-w.github.io/ https://nerf-w.github.io/