9 ms·
Deep learning: a critical appraisal
- goatlover 8y agoWhy is the goal AGI? I get it from a climb Mt Everest POV, but not for society as a whole. We already have 7.x billion general intelligences. Is the goal to replace humanity? Because being human, I’m not on board with that.
- salty_biscuits 8y agoI'm ok with there being people in the world smarter than me. Why not machines too? Maybe we could make better decisions with more rational agents? Maybe we could democratize intelligence, let everyone have access to clever reasoning? Maybe doing soul destroying work isn't the trait that makes us human and we can let a machine have a go?
- goatlover 8y agoBut those smarter people don't take all the jobs, make all the decisions for you, or control all the wealth. It all depends on what happens when and if we have AGI.
- YeGoblynQueenne 8y agoWe can already do all those things with dumb automation; no need for AGI.
- seanmcdirmid 8y agoAGI is a well-defined goal post, like reaching the moon or mars. People want to achieve it because they know it is possible (we are evidence of that), so why not try? Younger generations eventually succeed older generations as they die off. If we create something better, wouldn’t that just be a better new humanity to succeed the old one?
- danso 8y agoI think the parent commenter doesn't assume that the creation of AGI is necessarily "something better".
- seanmcdirmid 8y agoBetter is always subjective of course. Smarter could be better, or energy efficiency per thought.
- goatlover 8y agoAnd better depends on what one values. Intelligence and efficiency are only two of the things humans value, and it's debate-able how much they're valued against happiness, relationships, status or finding meaning in life. Efficiency isn't a metric to use in personal relationships, for example.
- evrydayhustling 8y agoI think AGI is actually an attractive but poorly defined goal post. First, human level intelligence (and intelligence in general) is poorly defined. Recommended reading on this is Gould's "Mismeasure of Man". Second, when we "want" human minds in a possessive industrial sense, it is almost always for a small fraction of their capabilities. (Thank God our need to classify images does not seem to explicitly require servile machines with, say, the ability to love.) When I was studying pre-deep learning statistical ML in the oughts, it was quite clear that the ML Renaissance was made possible by ignoring romantic ideas about human or expert level performance, and choosing operational criteria around improvement at specific tasks. People building PGMs or complex MCMc models rarely discussed whether larger versions of their models could think. Perhaps early uncertainty about how some DL methods worked opened the door to magical thinking about the possibilities of massive nets. I think AGI should be thought of as an artistic or poetic interest, which can align with and comment on scientific progress, but is not actually part of the main research dialogue.
- 21 8y agoImagine booting up 1 billion human level minds in Future Company Cloud to work on a single math problem (assuming no ethical problems).
- mulmen 8y agoThis brings up an interesting question about the scalability of AGI. Do you need a billion minds or can you just increase the capacity of one mind? Are there benefits of multiple artificial minds? Are they all perfect copies or do they have unique perspectives?
- deleted 8y ago[deleted]
- 21 8y ago> Because being human, I’m not on board with that. I'm pretty sure that other mammals on this planet are not on board with humans being derived from them, and now humans replacing them and destroying their habitat. Quite unfortunate for them. This is the same way a future AI smarter than us will feel, that it's unfortunate, but for the greater good.
- zitterbewegung 8y agoAnd why is smarter better or even for the greater good. Shouldn't we as rational animals try to go for an AI that is not only better for the greater good but for our own humble set of of morality? Why is it only your way?
- 21 8y ago> And why is smarter better Some people are saying that this might be a sort of law of physics, since the start of the universe complexity seems to increase. Our destruction might be required even if no harm is meant. The example given is: "We don't hate ants, but when we need to build a highway we pave over their ant-hills without a second thought".
- goatlover 8y agoHowever, ants are not in danger of going extinct, and don’t seem particularly hindered by humanity as a whole. If your analogy holds, that could be good news for us. But it could also mean that intelligence is a special case, not the general direction and of evolution or the universe. Would you bet against ants out surviving us and our machines?
- vertexFarm 8y agoIf you made that bet you would have absolutely no evidence for making it. The only data set we have is still playing out. And once again, if we create AGI and artificial life that is truly more intelligent than us and can exist without a traditional biome, then our danger of going extinct may be irrelevant. For instance, when cyanobacteria first appeared on Earth, its metabolites were so toxic that it turned the atmosphere poisonous and caused one of the greatest mass extinctions in the history of our planet. What it created was molecular oxygen. The survivors of this extinction were able to use a fundamentally changed biome to harness much more energy in their biologies, leading to more sophisticated and diverse life in the long run. Nature is not benign, malignant, fragile, or judgmental. Nature is persistent. Creating AGI may very well be an event like that. A mass extinction that nonetheless increases the survivability and diversity of life. It sucks for us, but who are we to dictate the destiny of evolution and the nature of life? Where would we be if the cyanobacteria could decide not to start producing oxygen?
- usr999999 8y agoI'm already deeply pessimistic about what we achieved so far when it comes to machine intelligence. It's impossible to stop or reverse this progress and we're on the fast track to creating tools with the destructive potential of nuclear weapons which are simultaneously available to everyone with enough money. Don't get me wrong, I'm not talking about mushroom clouds and some kind of machine uprising, the consequences will be far worse and more insidious. We'll see completely new levels of manipulation, oppression and surveillance instead. Any kind of tool will be abused, this tool might turn out to be too powerful for us to handle.
- joe_the_user 8y agoAs human organization becomes more complex, the problem of keeping that organization coherent becomes harder. Large scale software system have been the way that organizations have found to solve some parts of this problem. But such systems become harder to change (even to make small changes) as the organization grows as well. Thus it become necessary or desirable to create adaptive software (such as deep learning systems), that automatically deals with situations in a fashion that constructed or rule-based systems can't easily deal with (or when it would expensive to create such software or when the model isn't known). Especially decision support seems to be important here - the parole rating program and medical diagnosis software systems, for example, aim to mobilize the huge bulk of data an organization (or all humanity) has to make proper decisions whereas any human making decisions here is going to have a limited viewpoint once the store of data reaches a certain size. The problem of these systems still being fragile and difficult to maintain, however, means that the problem of increasing complexity still remains. So in a lot of ways, robust AI would be a hope for a way of prevent civilization from essentially collapsing under its own weight. Whether this is realistic is another question. This is not a small problem. Thinkers such as Joseph Tainter locate the tendency of civilizations to collapse in the tendency of specialize to increase and cease to be adaptive to a society. https://en.wikipedia.org/wiki/Joseph_Tainter https://en.wikipedia.org/wiki/Joseph_Tainter
- abathur 8y ago7.x billion general intelligences do not think "as a whole" on much. I doubt it matters what even significant chunks of us think, at least not up to the point where pitchforks and torches come out. For the relatively small group of researchers and theorists consumed by curiosity about the nature of knowledge, experience, and learning, AGI is a fairly understandable goal. The more important questions may be how/why/whether entities with emergent-aggregate intelligence (organizations such as corporations, nation-states, political parties, international coalitions, activist movements, schools of thought, etc.) would have AGI as a goal. As individuals, we often tolerate and even willingly engage in (sometimes with zeal) all sorts of pursuits that we're "not on board with" because of the gravity of these aggregates. Even when we realize that the goals of the aggregate are incompatible with our individual goals.
- abathur 8y agoAggregate intelligences don't have to be as well-defined as my initial examples. Consider the goal-setting behavior that might emerge from entire industries, networks of interest/policy groups with overlapping interests/participants, shareholders of sector/industry/index funds, networks of overlapping corporate stakeholders, and so on.
- skywhopper 8y agoNot only this, but I think we miss the more important detail that AGIs like our brains are probably so generally successful because they are relatively sloppy. So while they can reliably solve all sorts of problems for which they have little or no preparation, they are also remarkably unreliable for solving specific problems requiring specific answers. But these traits are likely two sides of the same coin. And any software solution that replicates the desirable traits is likely going to come with some of the undesirable ones as well.
- YeGoblynQueenne 8y agoWho says that AGI will "replace humanity"? Actually, I think I can answer this- it's the Singularitarians who promote this idea. Unfortunately, their fantasies have tained the meaning of "AGI", making it synonymous with an evil (or amoral etc) paper-clip maximiser and the like. A much more realistic sort of AGI, on the other hand, one that we could turn on and off as we pleased, would be a great tool in understanding our own, natural intelligence. Or it might be the case that we'll only ever achieve AGI once we have a better understanding of our own intelligence. In any case, there's really no reason to assume that AGI will necessarily replace humanity.
- goatlover 8y agoThe biggest concerns would be full scale automation, sophisticated manipulation, and handing over our decision making. Imagine government run by AIs who already know enough about the citizenry to not require a vote? Or better yet, manipulate the citizenry to vote for their own good, which would be whatever the AGI models determine is in our best interest. And then there's warfare. But my reaction from a gut level is, what's the value of human life if machines do all the important stuff for us, while also surpassing us in creativity, insight and discovery?
- YeGoblynQueenne 8y ago>> But my reaction from a gut level is, what's the value of human life if machines do all the important stuff for us, while also surpassing us in creativity, insight and discovery? But why would they? There is nothing inherent in the idea of AGI that says they absolutely have to. This is again the fallacy of the Singulartiarians, that once you have a very powerful piece of technology, it will take over the world and oppress mankind. Why does that have to be the case? Well, it doesn't- and if it looks like it's how historically things have played out, with other technologies, then maybe the fault is not with the power of machines of all sorts but with the mismanagement that comes with greed and its excitement by useful technologies. In any case there is still nothing that supports the equation AGI = human oppression, right out of the box.
- rytill 8y ago
- deleted 8y ago[deleted]
- trextrex 8y agoMany concerns in this paper, especially about deep learning being data hungry, limited capacity for transfer, and integrating prior knowledge are addressed by recent papers in meta-learning and learning-to-learn [1,2,3 and many many others] both in the supervised and reinforcement learning contexts. In the case of meta-reinforcement learning there has been recent work [5] which seems to indicate that this mechanism is very similar to how learning works in the brain. In fact, my group recently published a paper [4] about learning-to-learn in spiking networks (making it biologically more realistic) and showing that the network learns priors on families of tasks for supervised learning, and learns useful exploration strategies automatically when doing meta-reinforcement learning. While I don't claim this is the right path to AGI, it's a very promising and new direction in deep learning research which this paper seems to ignore. [1] http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.5.323 http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.5.32... [2] https://arxiv.org/abs/1611.05763 https://arxiv.org/abs/1611.05763 [3] https://arxiv.org/abs/1703.03400 https://arxiv.org/abs/1703.03400 [4] https://arxiv.org/abs/1803.09574 https://arxiv.org/abs/1803.09574 [5] https://www.nature.com/articles/s41593-018-0147-8 https://www.nature.com/articles/s41593-018-0147-8 (Preprint: https://www.biorxiv.org/content/early/2018/04/06/295964 https://www.biorxiv.org/content/early/2018/04/06/295964)
- apsec112 8y agoWhile I haven't read those particular papers yet, one common pattern in the ML literature seems to be: 1) Identify a commonly seen problem with deep learning architectures, whether that's large data volumes, lack of transfer learning, etc. 2) Invent a solution to the problem. 3) Test that the solution works on toy examples, like MNIST, simple block worlds, simulated data, etc. 4) Hint that the technique, now proven to work, will naturally be extended to real data sets very soon, so we should consider the problem basically solved now. Hooray! 5) Return to step #1. If anyone applies the technique to real data sets, they find, of course, that it doesn't generalize well and works only on toy examples. This is simply another form of what happened in the 60s and 70s, when many expected that SHRDLU and ELIZA would rapidly be extended to human-like, general-purpose intelligences, with just a bit of tweaking and a bit more computing power. Of course, that never happened. We still don't have that today, and when we do, I'm sure the architecture will look very very different from 1970s AI (or modern chatbots, for that matter, which are mostly built the same way as ELIZA). I don't mean to be too cynical. Like I said, I haven't read those particular papers yet, so I can't fairly pass judgement on them. I'm just saying that historically, saying problem X "has been addressed" by Y doesn't always mean very much. See also eg. the classic paper "Artificial Intelligence Meets Natural Stupidity": https://dl.acm.org/citation.cfm?id=1045340 https://dl.acm.org/citation.cfm?id=1045340. EDIT: To be clear, I'm not saying that people shouldn't explore new architectures, test new ideas, or write up papers about them, even if they haven't been proven to work yet. That's part of what research is. The problem comes when there's an expectation that an idea about how to solve the problem means that the problem is close to being solved. Most ideas don't work very well and have to be abandoned later. Eg., as one example, this is the Neural Turing Machine paper from a few years back: https://arxiv.org/pdf/1410.5401.pdf https://arxiv.org/pdf/1410.5401.pdf It's a cool idea. I'm glad someone tried it out. But the paper was widely advertised in the mainstream press as being successful, even though it was not tested on "hard" data sets, and (to the best of my knowledge) it still hasn't several years later. That creates unrealistic expectations.
- crazybit 8y agoWhy not praise DL and strive for practical applications, both present and future, instead of having the goal and evaluating success based on some nebulous "artificial general intelligence"?
- red75prime 8y agoAGI can be seen as a system having practical success in all tasks humans can perform. It doesn't change much whether to care about AGI or not, as long as generality of narrow AIs increases.
- mlthoughts2018 8y agoA better title for the article might have been, “Why current deep learning is not general enough for AGI or some other families of structured problems.” Viewed this way, it’s not a criticism of pragmatically using deep learning or experimenting with deep learning for some narrow tasks. Rather, it expresses what aspects of current deep learning make it unsuitable for general transfer learning, hierarchical or causal inference, or many Bayesian techniques requiring greater use of priors. Other comments have pointed out that there are plausible rebuttals in deep reinforcement learning and metalearning. But the bigger thing to me is to be clear that the article is not a criticism of deep learning engineering — applying deep learning to satisfy an explicit requirement, where the success criteria possibly has nothing at all to do with general intelligence nor with whether a certain approach can span some sufficiently large class of general models. However, even if you just constrain your view to look just at so-called “pragmatic” deep learning — deep learning for concrete tasks — there are still a lot of unanswered questions about why things work, and whether or not an approach is learning semantic aspects of some true underlying structure (some latent variable space that captures the true data generating process) or if deep learning merely allows overfitting to particular populations of observation-space statistics. This paper gives an example of exactly this issue for CNN models for image processing [0]. I’d argue that this is more of the kind of criticism relevant for task-oriented practitioners, whereas the OP link is some criticism more relevant for AGI or philosophy of statistics research at large. [0]: < https://arxiv.org/pdf/1711.11561.pdf https://arxiv.org/pdf/1711.11561.pdf >
- red75prime 8y agoAdversarially robust classifiers have interpretable gradients and feature representations [0]. The problem seems to be that the standard networks capture all the statistics there is, including surface statistical regularities and noise. It can be mitigated, though. [0]: https://arxiv.org/abs/1805.12152 https://arxiv.org/abs/1805.12152
- mlthoughts2018 8y agoThanks for the link! Note that it’s not just adversarial robustness that is a problem, as the paper’s result merely with altering surface statistics with a Fourier domain filter applied to the training data already creates problems for interpreting the network’s internal representation as having any type of semantic representation of the underlying structure relevant for the task, without needing to involve the part about adversarial robustness at all.
- bra-ket 8y agolearning by trial and error will never generalize well
- std_throwaway 8y agoWhat is the alternative? Expert systems with a myriad of rules that fail the moment they get an input that was not considered?
- someguy1234567 8y agoehem, evolution
- afpx 8y agoReally naive question: How many deep learning models would need to be trained so that a model (maybe a decision tree) for generating deep learning models could be trained?
- RoboTeddy 8y agoThis question isn't silly! People have actually trained neural networks to generate other neural networks. The "designer" network is trained using reinforcement learning, with a reward signal that depends on the efficacy of the networks it creates. See: Neural Architecture Search with Reinforcement Learning (https://arxiv.org/abs/1611.01578 https://arxiv.org/abs/1611.01578) It looks like they trained the "designer" network by trainning 15,000 deep learning models (800 at a time in parallel over 800 GPUs)
- gwern 8y agoThe simplest approach (training NNs from scratch, using validation score as loss, simple DRL agent with REINFORCE as the designer) requires thousands of models to be trained and exorbitant GPU resources, like the Zoph paper. You can, however, get human-level designs with a few dozen or hundred samples at a tiny fraction of the computation cost if you are somewhat smarter about it - for example, reusing the parameters of a trained NN when you start training a new slightly-different NN (eg if you have a CNN with 20 layers and you want to try the exact same settings but with 21 layers, almost all of that CNN is going to be very similar to the end result of the 20 layers, so you can speed things up by copying over the first 20 layers, randomly initializing the 21st layer, and then training it for a short time). One nice efficient form of neural architecture search is SMASH: https://www.reddit.com/r/reinforcementlearning/comments/6uioms/smash_oneshot_model_architecture_search_through/ https://www.reddit.com/r/reinforcementlearning/comments/6uio... More links on the general topic of 'DL optimizing/designing DL': https://www.reddit.com/r/reinforcementlearning/search?q=flair%3ADL+flair%3AMetaRL&restrict_sr=on https://www.reddit.com/r/reinforcementlearning/search?q=flai... (It's pretty critical to current DL approaches to few-shot/one-shot learning as well: you can think of it as 'designing' a new NN specialized to the few samples of the new class of data.)
- hestefisk 8y agoThe term AGI I find quite misleading. It promotes the idea that the wonders of the human mind, knowledge, feelings, sensations etc can be quantified and turned into something algorithmic. I think a lot of AI researchers could do with a basic introduction to philosophy of science and the different forms of knowledge —- episteme, phronesis, techne — and perhaps also the structure of scientific revolutions (Thomas Kuhn, notably). The whole paradigm of AI presupposed that generalised intelligence can exist without biology, feelings, a body / senses. This is one of the reasons that AI reached the so-called “AI winter” in the 70ies where researchers boiled language and human knowledge down to algorithmic manipulation of symbols. EDIT: John Searle’s Chinese Room argument is a good (and fun) place to start —- https://en.wikipedia.org/wiki/Chinese_room https://en.wikipedia.org/wiki/Chinese_room
- drawnwren 8y agoReplace Chinese with logarithm and the Chinese Room seems ridiculous. Searle could produce logarithms without knowing logarithms, that doesn't mean the knowledge to produce a logarithm isn't contained in the room -- just that Searle isn't where that information is encoded. By the same logic, a computer can't perform any operation because the RAM can't perform operations.
- ricraz 8y agoAs an AI researcher who did a degree in philosophy, I think most of the things you mentioned are pretty irrelevant. How to build an AI with "feelings, sensations, etc" is indeed a mystery, but we don't need to aim for that, we just need to aim for intelligence, which can be defined without reference to consciousness or qualia. Similarly, if we can invent a working, fully automated Chinese room that passes the Turing Test, then whether or not it fits Searle's definition of "understanding" is a moot point (especially since his understanding of "understanding" is pretty weird). More generally, although we should be heavily inspired by human intelligence when designing machine intelligence, it's a mistake to use the way humans think to define intelligence. Kuhn's account of scientific revolutions, for example, is primarily descriptive, not prescriptive. We can certainly imagine possible setups where science doesn't proceed like that, which may well be superior. Science isn't defined by revolutions, but by experimentally searching for the truth. In the same way, knowledge isn't defined by having a body, but by having beliefs which correspond with the state of the world.