8 ms·
We did not make sudden progress in AI because our algorithms are so smart – it worked because our researchers are smart about setting up the problem in just the
by AndrewKemendo 9y ago
We did not make sudden progress in AI because our algorithms are so smart – it worked because our researchers are smart about setting up the problem in just the right way to work around the limitations of current techniques.
This statement is like putting wheels and a motor at the base of the goalposts.
Everyone who practices ML knows the reality that while we're not going to see AGI for a while, and these systems are massively hard to build and do very narrow bounded things, they are also making massive progress in "intelligent" outputs at a pace we've never seen.
Yes, there is hype, but there are pretty solid reasons to be hyped.
We'll keep seeing people saying oh well it's not that impressive probably until AGI has clearly taken everyone's job in 2100 and we're all just providing training data for it.
- dennybritz 9y agoI agree. The point I was trying to make is not whether it is impressive or not (it is impressive!), but that the general press hype about "AI breakthroughs that will soon kill us all and need regulation" is over the top and misleading. The probably massive engineering effort that went into this is, to me, more impressive than the algorithmic innovation, if any. Progress is made with small incremental improvements, including this one, and there have been few real algorithmic "breakthroughts" over the past few years. That's why I think it is important to give some perspective to the hype.
- AndrewKemendo 9y agoI somewhat agree with that but I think the biggest (underappreciated) algorithmic improvement recently was MaskRCNN. The ability to do Segmentation and Detection in the same net is huge.
- visarga 9y agoBut isn't that slow? It doesn't parallelize well for real time processing, because it goes sequentially pixel by pixel while CNNs process all pixels in parallel.
- gnaritas 9y agoWhen should people attempt to regulate AI, when it's too late? Stopping a problem before it happens is called foresight. And if you pay attention to the press, it's not about killing us all, it's about disrupting the world, i.e. destroying jobs.
- semi-extrinsic 9y agoThe reason I don't buy the "destroying jobs" argument is that we have tens of thousands of jobs just in the small country where I live that could be automated away by 1980s technology. For a US-specific example, look at the way you submit your taxes. That shit could be 99% automated away, like it is in many European countries already, and you have several large companies that would come crashing down, together with many thousands of government employees suddenly without a job. There's no AI required. Why hasn't it been done already? Why should AI change that?
- gnaritas 9y agoThose jobs exist due to regulatory capture and the difficulty of changing tax law in a bitterly divided nation, just because a few industries found a way to use government to prevent progress and automation doesn't mean progress and automation isn't a danger; most industries won't be protected by regulatory capture. The "destroying jobs" thing is not an argument, it's a fact, it's what automation does, there's nothing to "buy", you either understand it or you don't.
- chii 9y ago> most industries won't be protected by regulatory capture. And that's s good thing. It's unfortunate for those whose jobs are automated away, but without automation, goods and services can't keep up with the increase in population and demand. What's needed isn't prevention of automation, but how to increase the number of people with enough education to implement even more automation.
- gnaritas 9y ago
- sweden 9y agoI feel that you are missing the whole point of "AI breakthroughs that will soon kill us all and need regulation". It's not about AI becoming self-aware and start to proactively taking over humanity starting from a Dota game, it's how we are finally capable of putting AI anywhere. The point Elon Musk was trying to show is that nowadays, we have the technology and the research to replace humans by AI for making judgement calls, no matter how difficult it is. And this was proven with a "simple" game of Dota. And if we are able to build a system to play Dota, we are also able to build AIs for anything at all. You claim that there had not been any real breakthroughs over the past years but truth to be told, today we have AI playing Go, AI managing self driving systems, AI playing games of Dota against the top players. All of this happened over the last few years, 5 years ago this all felt like a distant future.
- scribu 9y ago> AI playing games of Dota against the top players This example weakens your argument. As TFA explains, the bot can only play a very restricted version of Dota - much simpler than chess - which means it was thinkable ever since the '90s, when Deep Blue beat Kasparov.
- lottin 9y agoSelf-driving cars have been around since the 1980s.
- debatem1 9y ago"nowadays, we have the technology and the research to replace humans by AI for making judgement calls, no matter how difficult it is" "if we are able to build a system to play Dota, we are also able to build AIs for anything at all" These are stated like facts, but are not facts. There are decisions made by humans which no AI system today can make well, and there are problems for which we have no idea how to build even mediocre AIs. The claim that someday we will have AGI is plausible but not yet certain to be true.
- sweden 9y ago"There are decisions made by humans which no AI system today can make well, (...)" Exactly, that is precisely the point. Companies and business will just rush to implement the next big neural network to boost their business, no matter how immature the technology is. And the claim is not about AGI, it's more about the little things. For some reason people like to think really big and exaggerated scenarios when it comes to AI. Let's take web apps as an example. We can all agree that the state of the art of the current web programming is very poor: JavaScript, NodeJS, Electron, CSS, etc. The technologies are bloated, they are slow, full of hacks and workarounds, and so on. And yet... people use them for everything, it's like the Atwood's law described: "any application that can be written in JavaScript, will eventually be written in JavaScript" I imagine that a similar scenario will happen with AI and neural networks. Can you imagine, for example, start dealing with an AI instead of an human when it comes to customer service? Maybe it is already happening, if you look for stories about Google's customer service in the internet, you would think everything is run by some sort of AI there. Another example, look at Microsoft is doing with Visual Studio's telemetry data: https://blogs.msdn.microsoft.com/dotnet/2017/07/21/what-weve-learned-from-net-core-sdk-telemetry/ https://blogs.msdn.microsoft.com/dotnet/2017/07/21/what-weve... I wouldn't be surprised if they built a neural network to feed all that data to and to have it to produce a UX "optimized" for mass consumption. We are getting into a time in which everything will be powered by "AI" and I think that's what OpenAI is trying to regulate before we get every single business pestered with an half-assed implementation of neural network and data analytics.
- flamedoge 9y ago> AGI has clearly taken everyone's job in 2100 and we're all just providing training data for it. This got me spooked. What will we do afterwards?
- AndrewKemendo 9y agoYour guess is as good as mine. Best case, is that we accept our fate as a species (that our purpose was to build AGI) and then the last 10 Billion of us are comforted in a species wide hospice type scenario until we die off. Worst case we kill each other with weaponized AGI's for a few years until it gets smarter and abandons earth leaving us basically where we started.
- thinkfurther 9y agoI'm not worried about actual AGI; infinitely powerful, not bound to the whims of any person or conglomerate. I see human atrocities born out of weakness, so I'm not worried about something that would have gain nothing from torturing or destroying us. That's assuming it can do and think everything we can, and doesn't need us as slaves. E.g. I like sparrows lots. I don't understand them, I wouldn't want them in my room, but I like seeing them do stuff on the periphery of my life. I can imagine AGI looking at us with an similarly friendly eye. But that won't happen, whatever grows, it will grow out of the diseased now. Today Trump says "I'm a very instinctual person, but my instinct turns out to be right. Hey, look, in the meantime, I guess I can't be doing so badly, because I'm President, and you're not,", tomorrow's Trump will have infinite power over anyone at the press of a button and no uncomfortable questions to even give non-answers to. They'll hand their power over to others who really want it, people who by definition will also be dysfunctional. As black and white as it may be, I think Erich Fromm's stuff about biophilia and necrophilia applies here, and necrophilia will win out, things staying the same and people staying as obedient as they are. No fate about it, just cowardice.
- AndrewKemendo 9y agoWell I think that's a reasonable thought but in my opinion it's not really describing AGI. Rather, it's describing something near AGI that can be controlled. That's why I am vociferously against the "Friendly AI" movement, because fundamentally humans aren't friendly - and that doesn't mean friendly in terms of agreeable or altruistic. Rather "Friendly" as used in the FAI sense, means "Does not reject or override the human values." In effect, the FAI movement wants to try to determine how you make AGI without it having it's own goal system. That it would always be subservient to humans. Which is only marginally a human trait. We pride ourselves as a species on not being beholden or enslaved by someone else's ethos. To try and extend that to human level machines is wrong ethically, and would just create unenlightened super soldiers. Could a sufficient independent AGI decide to wipe out all humans? Maybe, but in that case it would have come to that conclusion, and taken the steps necessary to achieve it (harder than AGI), on it's own. I don't find the paperclip maximizer or gray goo scenario a plausible argument against.
- thinkfurther 9y ago> AGI has clearly taken everyone's job in 2100 What would be impressive about that? How's that something to get hyped for? The ways people try to shed their humanity are already well described, and all that's left is to outsource the double think to machines that won't mind and that can't be asked uncomfortable questions about their childhood and such things. It's a straight line, moving decision making from the public to sphere to private corporations and from there to black boxes. The cause is still that some people haven't been acknowledged as babies or whatever trauma caused it; the more fanciful the cathedral the more banal the lie it covers up. All the interesting things about that have been written decades ago, these days it's back to dwarves cheerleading naked emperors. So the people who accumulate capital because of their stunted development will win out and buy it all, removing any persons worth a damn, and any chance for any to ever get born, for good; and being at each other's throats for the rest of eternity. It's the failure of humanity, not its apex. Just so you know.
- AndrewKemendo 9y agoWhat would be impressive about that? How's that something to get hyped for? I was being somewhat fatuous, as that is a common scare scenario. However, I do believe that it should be our goal as a human species, to create AGI as our intellectual successor. In the same way someone's child replaces them and they die, I think AGI should be our offspring and we as a species go peacefully into oblivion. It's my life's work to help see that happen. It's certainly an "out there" philosophy, but so far I haven't had anyone really challenge the logic when I spell it all out.
- rapind 9y agoSounds pretty lonely no? Wouldn't the most intelligent AI be the only one left standing (just extended globally)?
- AndrewKemendo 9y agoLonely for who? Mathematically, yes I would expect one would be left standing, but no reason it would have the same sense of loneliness. Or maybe it would - we wouldn't know.
- visarga 9y agoAIs would be better served by other sources of data - such as the game Dota2 - because they can get unlimited data to test out their strategies. What AIs need is simulators - in other words - a world/an environment for them, where they can freely move about, interact and learn. The success of AI is linked to the development of realistic sims. Fortunately, the happiness of many people is also linked to the development of realistic sims (games). They go hand in hand.
- AndrewKemendo 9y agoMy take is that AI's need the real world, with real world reinforcement loops. That's why I'm so focused on AR, it's a perfect human machine interface for training - specifically vision.
- justicezyx 9y ago> Yes, there is hype, but there are pretty solid reasons to be hyped. Can you list the “pretty solid reasons” to be hyped?