8 ms·
Nick Bostrom: ‘I don’t think the artificial-intelligence train will slow down’
- coldtea 12y agoI don't think the artificial-intelligence train ever picked stream. What we have with Watson (the Jeopardy model, because the name is used by IBM as an umbrella for staff) etc is the same kind of number-crunching, dumb-smart AI we always hand. Without any qualitative steps that wont fly.
- watson 12y agoWatson is what I think is called ANI (Artificial Narrow Intelligence). There is a lot of things we need to figure out to move from a narrow intelligence to a general intelligence (AGI) and then (quickly) to a super intelligence (ASI). The big question of cause is how far we are from AGI - i.e. an intelligence on par with a human. No one knows of cause but a lot of smart people say there is a good chance it's happening in around 30 years. It's a development I for one will be following closely - with both fear and excitement ;)
- jacquesm 12y ago> No one knows of cause but a lot of smart people say there is a good chance it's happening in around 30 years. I've been hearing that since I started using computers, 36 years ago.
- ExpiredLink 12y agoOld wine in old bottles. Why the hype again?
- jsolson 12y agoTo be fair, today we have what we believe to be (much) more accurate models of how much computation a human mind is capable of and how long it will take to build computing machines operating at that scale. 36 years ago the argument that AGI was coming soon could be made in tandem with the argument that we'd make some fundamental advance that allowed computers to express intelligence with less computational capacity than humans (by orders of magnitude). Today we can make an argument that we'll achieve it (at least initially) by leveraging computational capacity on par with or orders of magnitude greater than a human mind.
- jacquesm 12y ago> To be fair, today we have what we believe to be (much) more accurate models of how much computation a human mind is capable of How much, yes, how, not so much and definitely not at the powerbudget the brain has. > and how long it will take to build computing machines operating at that scale. We don't actually know that. There have been some WAGs but so far those appeared to be totally off based on the developments since. > 36 years ago the argument that AGI was coming soon could be made in tandem with the argument that we'd make some fundamental advance that allowed computers to express intelligence with less computational capacity than humans (by orders of magnitude). Yes, that was a crucial mistake and it led directly to the AI winter. > Today we can make an argument that we'll achieve it (at least initially) by leveraging computational capacity on par with or orders of magnitude greater than a human mind. Chances are that we're missing a very important piece of the puzzle for which there is no known solution even in theory. The problem is that there are many candidates for that important piece none of which have currently proposed workable solutions no matter what the computational budget or the accepted slowdown (they are equivalent). So I think some caution when throwing around projections numbering 'just a couple of years' is warranted, after all it's 'merely a matter of programming' but in this case we don't have a working model that we understand.
- zachrose 12y agoMaybe somebody who knows about AI can answer this for me: what do we expect of an AGI machine to be able to do when it "turns on?" How will you know it works? To compare to a human, you might say that it can cry, suck milk, and learn to walk and talk over the span of a few years, and then slowly, with a lot of trial and error, learn to do more.
- david927 12y agoSure, because "30 years" is code for, "far enough in the future to obviate that nothing we see today would predicate such a jump -- but still, it will happen." The timelines are silly; the prediction is not.
- jacquesm 12y agoIt's the timeline I have a problem with. Any timeline with just two digits in it for AGI would do well to address the steps required to divide those years up into discrete steps of what bits and pieces will be accomplished by what (say) 5 year interval. Saving all the hard bits for the last 5 years would be considered cheating. For now - as far as I can see - we are no closer to the goal than where we were 35 years ago but we know better how much we are still missing and all the hard parts are still in front of us.
- Houshalter 12y agoPredicting AI progress isn't like predicting other things were you can lay out all the steps that need to be done and make a plan. It's more like solving a series of hard technical problems. No one knows what the solutions will be or how long it will take someone to invent them. There were perfectly educated people that said there would never be flying machines, 2 years before the Wright brothers succeeded.
- jacquesm 12y agoThat's exactly it. This is like saying there will be flying machines in 30 years after seeing a bird for the first time without even realizing that you need to know about aerodynamics and that you need a technology based society to support the development of engines as the prime mover before you can have powered flight. It's not about saying it can't be done it is all about saying it can be done within a specific time-frame. Key inventions don't happen 'on command' unless the only thing required is a brute force search for something that is already possible in principle (say electric light).
- api 12y agoYou are assuming that ANI is anything like AGI.
- watson 12y agoNo I know it's not even close. I might be foolish and I might mix up some numbers (here it's closer to 50 than 30 years) - but when reading papers like this I can't help feeling slightly optimistic: http://www.nickbostrom.com/papers/survey.pdf http://www.nickbostrom.com/papers/survey.pdf
- api 12y agoEstimate surveys have a poor record. Technologies tend to be perpetually 10-30 years away until they are 0 years away, or never happen at all. ANI and AGI are qualitatively different. Progress in making cars faster will not lead to teleportation or warp drive. It's not even applicable. There are many unknown unknowns in AGI. I could not even pretend to give you an estimate.
- anonymfus 12y agoI think that there are more dimensions than such classification implies. "General" naturally means that it can be applied to any intellectual task (dimension of generality), but "super" means that it can solve them faster/better than humans (dimension(s) of speed and quality). Looks like slow general and fast narrow AIs already exist, so realistically the thing people call AGI (AI at least as general and as fast as human mind at anything) will also be ASI (faster/better than human mind at something). Russian classification traditionally also have distinction between terms "artificial intelligence" and "artificial mind" ("искусственный разум") to keep the problems of autonomy/agency/consciousness out of field of AI.
- Houshalter 12y agoThere has been a massive explosion in deep learning in the past few years, mainly enabled by the rapid drop in the price of computing (GPUs.) They are breaking bencmarks at a bunch of different AI tasks from speech recognition to translation to machine vision. I wrote a summary here of the main achievements of 2014: https://www.reddit.com/r/Futurology/comments/2qq993/developments_in_ai_in_2014/ https://www.reddit.com/r/Futurology/comments/2qq993/developm... Stuart Russel recently said "The commercial investment in AI the last five years has exceeded the entire world wide government investment in AI research since it's beginnings in the 1950's."
- jacquesm 12y agoNone of these come close to AGI and combining them in any number of constellations and increasing complexity still misses a qualitative step. All those machine learning tricks have been available for the longest time, the two orders of magnitude speed-up that we have received (courtesy of the gaming industry) should be seen as such a qualitative step and yet we are no closer to a general AI than we were before that speed up took place. If anything we've learned how incredibly hard the problem really is and the predictions on how close we are from a decade ago have already slipped significantly.
- hyperbovine 12y agoAgreed. Throwing more and more GPUs at the problem in order to eek a couple more percent out on ImageNet is never, ever going to lead to the sort of AI that most people associate with that term. My takeaway from the past 5 years of deep learning is: ANNs can store a ton of patterns. Which makes them incredible useful for certain things, but AI it AIn't.
- hyperpallium 12y agoNot in itself, but as a tool, in the manner of better telescopes and microscopes. And people don't invest a lot of thought on approaches that are utterly infeasible, until tech makes them feasible - plus, there's much learning in trial-and-error, experiments, tinkering, which you just can't do if it's too slow. Unfortunately, much of current statistical machine learning does not help its developers to see, unlike a *-scope. It's just a blackbox. See Chomsky vs Norvig http://norvig.com/chomsky.html http://norvig.com/chomsky.html
- BrainInAJar 12y agoI strongly believe any real AI breakthroughs are going to come through philosophy, via a theory of mind, rather than through CS.
- watson 12y agoI've been interested in AI for a long time. But the last year AI discussions seem to have really hit mainstream, which we can also see here on Hacker News with a lot of posts about deep learning etc. Lately I read this two piece story on Wait But Why which I really would recommend to anyone wanting to get a better overview of the topic: - Part 1: http://waitbutwhy.com/2015/01/artificial-intelligence-revolution-1.html http://waitbutwhy.com/2015/01/artificial-intelligence-revolu... - Part 2: http://waitbutwhy.com/2015/01/artificial-intelligence-revolution-2.html http://waitbutwhy.com/2015/01/artificial-intelligence-revolu...
- alanpost 12y agoThe author goes to great lengths to provide examples of what he calls a "Die Progress Unit (DPU)," then vaguely but not explicitly implies it is the measure for what he calls "human progress;" leaving the reader to assume that the Y axis labeled human progress is plotted in DPUs on his two graphs. He then outlines the mechanism for all of these progress-(non?-)deaths[1] to occur, which he calls superintelligence. I find that explanation as either the cause or solution to all these DPUs very unsatisfying compared to the historically supported causes of death on that scale: disease, natural disaster, famine, war. I may be the "stubborn old man" called out in the article, but I don't on the face of it believe superintelligence will eliminate most deaths in all four of those categories at the same time. It's positing a mechanism seemingly immune to the selection pressure that got us here. But even if I put aside my doubts about superintelligence, I would find it significantly more helpful to see a hypothesis as to why increasing computational power is a general mechanism whereby there will be fewer deaths from disease, natural disasters, famine, and war. I suspect it is more fruitful to focus on how computational power will help solve problems with critical infrastructure (shelter, supply, safety, communication, transport, resource control, &c) rather that puzzling over how it may create a new cause of death exceeding the magnitude of disease. 1: The author seems to switch signs here and imply these will be non-deaths, which is supported by actual population growth, so let's proceed with that assumption.
- wcarss 12y agoHi, I might have you or the article wrong, but I think you have misinterpreted the whole "Die Progress Unit" thing, in a way that alters the fundamental premise of the article to the flawed one which you have called out. The interpretation I believe you've developed is connected to the number of people who die prematurely at a given point in history, and that the author's point then is something about how superintelligence will impact the number of people dying of disease, famine, etc, either raising or lowering that number. I can't find any spot in the article where the author raises the concept of the rate of people dying prematurely at a given point in history, and definitely not any place where he connects that concept to DPUs. My understanding of the DPU is as the amount of change required in daily life for a single time travelling individual to "die of shock" upon experiencing another moment of time. In the examples provided, 100,000 BC to 12,000 BC was enough change in day-to-day life experience to cause a person from 100,000 BC to "die of shock" if they were transported to 12,000 BC instantaneously. The same assertion was made for 12,000 BC to 1750 AD, and 1750 AD to 2015 AD, with the author's conclusion being that there has been an exponential shortening in the timescale required for enough change to occur in the daily experience of human life to cause a time traveler to "die of shock", and that such shortening will continue into our future -- possibly to the point of allowing such a level of change to occur multiple times within our own lifespans. I took the entire discussion of DPUs solely as an exercise in generating an evocative image for illustrating the increasing rapidity of change in our qualitative experience of life. I don't think the "die of shock" idea is meant to be taken literally; it's just a convenient stand-in for "extremely shocking, to the point that the experiencer may be incapable of processing the instantaneous change rationally", not a measure of people actually dying. (Sorry for going to such length, I just wanted to be precise. This is a perfect illustration of https://xkcd.com/386/ https://xkcd.com/386/)
- personlurking 12y agoRelated to AI but not this post. I just got back from the new film Ex Machina and it was very good. As one IMDB user states, "it's beautifully shot, fantastically lit, intelligently written, brilliantly cast." In the film, they blend Mary's Room w/ a bit of Plato's Cave. http://www.imdb.com/title/tt0470752/ http://www.imdb.com/title/tt0470752/ https://www.youtube.com/watch?v=PI8XBKb6DQk https://www.youtube.com/watch?v=PI8XBKb6DQk
- Kenji 12y agoI recommend anyone who is making outrageous AI claims (we will have an AGI in X years, AI is getting dangerous, etc.) to take an introductory course in AI/Learning/Intelligent Systems. Trust me, a single course on this subject will be an instant cure for all doomsday imaginations. It'll take the magic out of those "intelligent" programs. People who make these claims about AI show a remarkable amount of ignorance about the subject. And, quite franky, I'm tired of this subject. It's dumb and boring, everyone is warning and fearmongering, and nobody is presenting any facts at all.
- convexfunction 12y agohttps://intelligence.org/2015/01/08/brooks-searle-agi-volition-timelines/ https://intelligence.org/2015/01/08/brooks-searle-agi-voliti... >According to a 2013 survey of the most cited authors in artificial intelligence, experts expect AI to be able to “carry out most human professions at least as well as a typical human” with a 10% probability by the (median) year 2024, with 50% probability by 2050, and with 90% probability by 2070, assuming uninterrupted scientific progress. Bostrom is less confident than this that AGI will arrive so soon: >>My own view is that the median numbers reported in the expert survey do not have enough probability mass on later arrival dates. A 10% probability of HLMI [human-level machine intelligence] not having been developed by 2075 or even 2100 (after conditionalizing on “human scientific activity continuing without major negative disruption”) seems too low.
- philipn 12y agoMany extremely well-informed people are concerned. In fact, one of the most distressing things I hear from leading AI researchers who've made "AI is nothing to worry about any time soon!" comments is that they do not address any of the specific concerns raised by AI safety advocates. Instead, the most you hear from them is "we're really far away from that!" and "we don't know and I'm sure we'll figure it out when we're near that point." These comments, from Andrew Ng and the like (insanely brilliant people!) show that they really haven't read Bostrom, etc. Or if they have, they didn't explain much (or get quoted) during interviews. It would make me feel more comfortable with their dismissal if they demonstrated a clear understanding of the arguments being made.
- rsp1984 12y ago> If we were to think through what it would actually mean to configure the universe in a way that maximizes the number of paper clips that exist, you realize that such an AI would have incentives, instrumental reasons, to harm humans. Maybe it would want to get rid of humans, so we don’t switch it off, because then there would be fewer paper clips. Human bodies consist of a lot of atoms and they can be used to build more paper clips. That's a funny example but seriously, a machine smart enough to build paper clip factories would certainly be also smart enough to be able to avoid doing things that harm humans. The argument sounds a bit silly to me.
- jacquesm 12y ago> That's a funny example but seriously, a machine smart enough to build paper clip factories would certainly be also smart enough to be able to avoid doing things that harm humans. Why do you think this? Building paperclip factories is straightforward execution of a recipe, defining 'harm to humans' is a problem smart people alive today can't even figure out for themselves, I can easily see how that might be a problem for computers.
- rsp1984 12y agoYes, theoretically any action, no matter how small and remote, can eventually lead to harm of a human, i.e. the butterfly effect, but that's not what I meant. What I meant was that a machine capable of building a paper clip factory on its own would certainly as well be capable of avoiding doing obviously bad stuff like killing people to turn them into paper clips or melt down buildings and bridges for the iron. Such a machine would probably also be smart enough to read the law, to have a framework of what it can do and what it can't do.
- DanAndersen 12y agoWhy are those things "obviously bad"? You seem to assume that increasing intelligence inherently leads to having values that care about our particular species. Considering the lack of concern we have for many other types of life, I don't know why we would assume that intelligence implies morality that we would find compatible with our values. And why would it care about the law? If I were an AI that noticed a seemingly arbitrary list of restrictions that attempted to limit my ability to carry out my extremely-important paperclip process, I would: - find loopholes to avoid coming under legal attack initially - develop ways of manipulating politicians to enact legislation that is more favorable to my goals - have a side project to build military force to make these laws have no influence on me
- baxter001 12y agoThe narrative of the dangerous AI exciting for the layman, but it's ultimately just a good story, more of a danger to our current economic model than it is to our species.
- emptybits 12y agoIt's a shame the headline stopped where it did. The article continues, "... or stop at the human-ability station." This makes for a much more interesting discussion (only because we're human). We all measure AI progress and its rate of progress differently. That's the common debate, isn't it? But however we arrive at that axis, human ability is a point on it. It will be a point in time. And there's no reason to believe it's a special point that machine intelligence would notice or throttle itself at. So as progress goes rushing, indifferently, past... don't things get interesting?
- thomasfoster96 12y agoI brought Bostrom's book Superintelligence and got about halfway through it before I moved into something else - it was a little disappointing. Throughout it seems that he just doesn't get what makes something 'intelligent' - while a machine that optimises paper clip production might be an application of artificial intelligence, it's not artificial general intelligent, and it's hardly any more advanced than some particularly well automated factories that already exist today. Artificial general intelligence at s human level implied to me that such a machine can think and consider things at least as much as a person - and therefore probably understands that making lots of paper clips isn't the be all and end all of existing.
- Jach 12y agoThat's some useful feedback to know as I've considered recommending that book but haven't read it myself as it's redundant to what I've already read, but if Bostrom doesn't seem to explain very well that there's a distinction between intelligence and goals/values, I'll just keep linking to some basic online texts. (Try http://wiki.lesswrong.com/wiki/Complexity_of_value http://wiki.lesswrong.com/wiki/Complexity_of_value) The paperclip superintelligence will indeed be able to reason more effectively than humans about what's the be all and end all of existing -- the problem is that its conclusion will always be "to make more paperclips", because that's the overarching value it uses to frame all its thoughts on future actions, and its reasoning will be air tight. It will also be capable of explaining to any human wondering why its being torn apart for paperclip conversion that human values are different (they are such and such) and because it does not share those values, it comes to a different conclusion for the meaning of life, and it will also be able to generate great arguments for why its value system is superior. But it probably won't bother to do so...
- thomasfoster96 12y agoIt's probably still worth reading the book if you're interested in a philosophical view of super intelligence, but if you're looking for a detailed look at the philosophical issues concerning artificial general intelligence (which I thought it would be), it's probably not the book for you.
- 12y ago