4 ms·
>> This arms race will potentially speed up the pace of AI development and shorten the timescale for getting to AGI. ... or it will all fizzle out once it beco
by YeGoblynQueenne 8y ago
>> This arms race will potentially speed up the pace of AI development and shorten the timescale for getting to AGI.
... or it will all fizzle out once it becomes clear that classifiers trained from immense datasets can't get to AGI.
In the last few months I've noticed a sudden uptick in papers and articles on the limitations of deep learning and even a few conferences discussing the way to overcome them (e.g. Logic and Learning at the Alan Turing Institute). Eventually, the hype will die down, people in the field will feel more confident discussing the weaknesses of deep learning and the general public (including the industry and the military) will catch on. Then we'll move forward again when the next big thing comes along.
- evrydayhustling 8y agoI fully agree that there is an ongoing reckoning with the limitations of deep learning, but that is the sign of a thriving community not a failing one. Also, AGI is a misplaced milestone, even as OP explores a more interesting one: as incremental advances in AI empower non-human entities (corps and governments) with unique powers of surveillance and autonomous action, the impacts can be just as important as if it were a machine intelligence. The uptick in articles is just a sign that it's trendy to poke holes in hype. Expecting AI to go away is like expecting the Internet (another fundamental shift that was announced with an annoying hype bubble) to go away. It's just becoming a part of life, and creating new power structures while it does.
- aalleavitch 8y agoI’ve long believed the first true “AGI” will be a corporation in which all of the individual jobs have just been automated out of existence one by one over time. Eventually, many companies will essentially just become autonomous entities under the direction of shareholders. It may even have protocols put in place to determine when to hire outside consultants to come in and improve itself.
- nerdponx 8y agoI fully agree that there is an ongoing reckoning with the limitations of deep learning I would go a step even further. I don't think this even justifies being called a "reckoning", we are just finding the limits of something that we have not yet found the limit I would go a step even further. I don't think this even justifies being called a "reckoning", we are just learning its limits.
- YeGoblynQueenne 8y agoHas there been a misunderstanding of my comment? I didn't mean to say that I expect "AI to go away". For one thing, I certainly do not equate all of AI to deep learning, or even machine learning. My point is that deep learning has generated a lot of excitement in the last few years, but as we're hitting inevitable diminishing returns the excitement is dying down and people are starting to think about how to move beyond current techniques. As usual, the last to catch on to the reversal of the old trend, or the new trend if you prefer, are the people who pay the money- industry investors or the military etc, and then the general public. My money is on using deep learning for "low-level" sort of sensory tasks and then GOFAI, symbolic techniques, for high-level reasoning. There has been some recent activity on trying to marry symbolic reasoning and deep learning (e.g. differentiable ILP, from Evans and Grefenstette in DeepMind [1] etc) and it's a promising line of research that has the potential to yield "best-of-both-worlds" results. But - "AI going away"? Not any time soon! ________ [1] https://arxiv.org/abs/1711.04574 https://arxiv.org/abs/1711.04574 Although note that their assertion that ILP can't address noisy or ambiguous data is plainly wrong :)
- sangnoir 8y ago> Has there been a misunderstanding of my comment? I didn't mean to say that I expect "AI to go away" The "it" in your original comment makes the subject ambiguous - your comment can be interpreted as saying AI itself (not the arms-race) will "fizzle out". I agree that AI's hype cycle is nearing the "trough of disillusionment" stage, but after that will come a wider and deeper application of AI in a multitude of fields and industries instead of the narrow applications today. Even the diminished returns are worth chasing if it increases your turnover by 1-2%.
- YeGoblynQueenne 8y ago>> I agree that AI's hype cycle is nearing the "trough of disillusionment" stage, I'm sorry but I never said anything like that. AI is not the same as deep learning. It's deep learning that has been hyped in the last few years, not AI in general. Of course, in the lay press, there is a great confusion between AI, machine learning and deep learning- but I don't see why there should be an assumpion that I, too, am equally confused about those terms. In any case, it should be easy to dispel any misunderstandings by a quick look at my profile- I'm an AI PhD research student. I would hardly claim that AI is about to fizzle- or even deep learning. What is being discussed in the quote from the original article is the purported arms race to AGI. And how could AI "fizzle" now- when it has been growing as a field for the last 60+ years? Honestly, I don't see how any other interpretation of the "ambiguity" in my comment can be justified, assuming good faith. I sure had to squint really hard to see any ambiguity at all.
- nopinsight 8y agoSimpler neural networks clearly have limitations that we might be reaching. Recent papers from DeepMind and OpenAI, among others, show that one can develop more sophisticated architectures that can solve some complex real-world problems much better than vanilla networks, however. Granted we are still far from AGI even with these new advances, but given the progress of the field in the last few years as resources pour in, we cannot say for certain that AGI won’t be reached in our lifetime. One watershed moment I would look out for is when an AI wins a Starcraft tournament. Winning Starcraft requires many of the ‘general intelligences’ humans excel at (relative to current machines). In my estimation, it is much harder than Go (continuous state space, multi-agent interactions, etc.). DeepMind has announced they are working on it but I’d guess we are at least 2, likely 5 or more, years away from achieving the milestone.
- YeGoblynQueenne 8y ago>> Granted we are still far from AGI even with these new advances, but given the progress of the field in the last few years as resources pour in, we cannot say for certain that AGI won’t be reached in our lifetime. The progress of the field in the last few years is limited to improvements in performance on specific benchmarks all of which pertain to classification specifically and only in a few domains- speech recognition, image recognition and lately game-playing (the function of the deep nets in the AlphaGo family is still essentially discrimination of good vs bad moves, rather than, say, complex reasoning). So, unless classificiation -in fact, classification in speech and image recognition and game-playing- is sufficient for the development of AGI, yes, we can say with pretty good certainty that there is no clear path from the current state of affairs to AGI and therefore, no good reason to assume AGI will be achieved within our lifetimes. Of course, we can't ever say anything with absolute certainty. Perhaps we live in a simulated universe and the Simulators will switch it all off tomorrow. Perhaps aliens will make first contact and hand us all the tech we're missing - or exterminate us all. Perhaps dread Cthulhu will rise from his sleep at R'lyeh Ia! Ia! etc. But- reasonable predictions can only be made based on what we know so far. The rest is only wild speculation that doesn't really serve anything, except of course to satisfy one's imagination.