7 ms·
The adage that we overestimate technology in the short term and we underestimate it in the long term holds. There is no way we all have a personal AGI assistant
by ipnon 4y ago
The adage that we overestimate technology in the short term and we underestimate it in the long term holds. There is no way we all have a personal AGI assistants that drive our cars and work jobs for us this decade. At the end of this century we will all have this technology, barring any one of the possible apocalyptic catastrophes besetting us at present. The question is whether this advance is possible without some irrational exuberance today. We need the cult of AI to inspire us to think it’s even possible in the first place.
- arise 4y agoThere's also the AI adage that you don't get to the moon by building successively larger ladders... all this deep learning stuff is great and will unlock amazing value (esp if we fund open data+models), but we run the risk of exhausting consumer and government patience if we keep promising the world with this single family of techniques.
- TremendousJudge 4y agoNot sure if the analogy holds. Human brains work on the same principle as lizard brais, no change in strategy was needed to go from lizard intelligence to human intelligence. I'm not saying that DL holds this promise though.
- russdill 4y ago
- Zamiel_Snawley 4y agoBe kind. Don't be snarky. Have curious conversation; don't cross-examine. Please don't fulminate. Please don't sneer, including at the rest of the community.[1] [1] https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- deleted 4y ago[deleted]
- eternalban 4y agohttps://en.wikipedia.org/wiki/Triune_brain https://en.wikipedia.org/wiki/Triune_brain There are distinct architectures and our brains have additional architectural features that lizards' lack. https://en.wikipedia.org/wiki/Basal_ganglia https://en.wikipedia.org/wiki/Basal_ganglia https://en.wikipedia.org/wiki/Limbic_system https://en.wikipedia.org/wiki/Limbic_system https://en.wikipedia.org/wiki/Neocortex https://en.wikipedia.org/wiki/Neocortex
- TremendousJudge 4y agoYes, but unlike a ladder and a rocket, they are not fundamentally different. This is why I don't think the analogy holds. Evolution iterated over the same model, never starting again from scratch.
- obblekk 4y agoThat's interesting and something I hadn't heard before. Any pointers to further reading on why deep learning might be a dead end?
- burnished 4y agoThey didn't say it was a dead end. I think their observation is rooted in gradient descent and how it improves but gets stuck in local maximas, when that solution might never be good enough. Hence the ladder. No matter how good you get at ladder making it with take you to the moon, but it will get you closer the entire time you improve at it.
- PeterisP 4y agoFor a contrasting viewpoint, there's always Sutton's Bitter Lesson - http://incompleteideas.net/IncIdeas/BitterLesson.html http://incompleteideas.net/IncIdeas/BitterLesson.html
- vba616 4y agoHow about a simple explanation of why it seems palpably absurd to some people that it will not be a dead end? Consider a teratoma or lab-grown organ. Is grafting or engineering another attached sensory mechanism going to bring it closer to being an ordinary organism? I think whether capabilities are super- or sub- human is a red herring. Even a really primitive organism is still taking all of its computational capabilities and outputting, implicitly, decisions in one context that is its perceived reality. A collection of computation and perception modules does not do this, without something else. I don't think developing "something else" is obviously impossible or would require magic. But I'm not sure anyone sane would want to create it when it inherently creates unlimited risk of running amok. This is what the LessWrong people are afraid of, aren't they?
- danaris 4y agoI think it's important to distinguish between something that's a "dead end" in that it will take you nowhere interesting, and something that's a "dead end" in that it will, after a certain point, cease advancing. The former would imply that there is no point using deep learning and other similar techniques at all, and is the common implication when people say something is a "dead end". The latter is what I believe the current generation of machine learning to be: I do not believe it will lead to AGI, and I am skeptical that it can do a great deal more than what it has already done (it can continue to refine the types of things it already does, and I expect it to do so, but I don't think it will open up new categories of things it can do many more times). But despite that, it does do some very cool things now, and as they are refined, I think they can be commercially successful and generally beneficial tools.
- elcomet 4y agoYou are as overconfident as they are to say that there is "no way" that those things happen. Let's try to not make false promise one way or another, just wait and see.
- notart666 4y agoNo the majority of researchers in the field who have been researching for decades already know deep learning isn't the correct way forward it's just the vocal minority claiming it not to be true for nothing more than purely financial interests.
- ghaff 4y agoThe autonomous driving question is an interesting one. It's probably some combination of techno-optimism, naive extrapolation of deep learning advances over a fairly short period of time, and--yes--at least some degree of a massive game of topper because everyone else was feeding at the funding trough and saying things were right around the corner. How much of each doubtless depends on the person. And a lot of other people listened to the vocal "experts" and assumed that they must know what they're talking about.
- mindcrime 4y agoNo the majority of researchers in the field who have been researching for decades already know deep learning isn't the correct way forward (playing Devil's Advocate here) That doesn't even make sense. Correct way forward to what exactly? I guess if you assume that the only valid goal of AI research is to eventually achieve AGI then you might have a sort-of valid point. Except that nobody "knows" that deep learning isn't the way forward to AGI. Nobody "knows" that it is either. But all of that said, current deep learning research has absolutely created systems that do amazing things and create tremendous value for society. So in what sense can we say that it "isn't the correct way forward"? Do you suggest abandoning DL completely? If so, in favor of what? (OK "Devil's Advocate" portion over) My own position has long been that "just deep learning" might be sufficient to achieve AGI if we eventually make networks that are big enough to support the right kind of emergent behavior. But I've also long been skeptical that this is the most direct or efficient path to AGI. I'm an advocate of hybrid symbolic/sub-symbolic systems that integrate deep learning with other AI strategies.
- JohnHaugeland 4y ago> My own position has long been that "just deep learning" might be sufficient to achieve AGI as soon as you say agi, you've lost the plot.
- tikhonj 4y agoThere's some real selection bias in that observation: if we overestimate a technology's impact in the long term, nobody's going to remember the technology or the estimates by the time the long term rolls around.
- Gtex555 4y agoself driving cars would be easy if all the cars on the road were self driving, what makes it difficult is getting them to operate in an environment with illogical human drivers.
- Afton 4y agoI'm certainly unconvinced that the first part of that statement is true. We've seen self-driving cars run into static obstacles. We still need to deal with emergent behaviour of groups of self-driving cars. There are still unpredictable environmental factors that we rely on humans to work out now.
- hahaxdxd123 4y agoNo, pedestrians and cyclists still exist.
- nradov 4y agoAnd animals and weather and road damage...
- xboxnolifes 4y agoSelf driving cars would be easy if all cars were self driving, all roads were designed for self driving cars, roads did not degrade, there are no pedestrians, no cyclists, trash or other obstructions could appear on the road, weather did not exist, and the sensory hardware could not get damaged or obstructed.
- mikro2nd 4y agoAnd even then... Any sufficiently complex system is chaotic (behaves in surprising, non-linear ways). And traffic networks pretty certainly constitute a sufficiently complex system.
- TremendousJudge 4y agoAnd they already exist under these conditions: automated subway trains.