14 ms·
I've really gone sour on the singularity in recent years. It seems to be yet another one of those cases where someone projects out from incomplete data and ass
by jandrese 7y ago
I've really gone sour on the singularity in recent years. It seems to be yet another one of those cases where someone projects out from incomplete data and assumes unbounded infinite growth despite the fact that such a thing never happens in nature. Any time you see someone project out in a simple exponential growth curve you know their projection is bullshit. Growth curves are always S-Curves. Always.
It's like asking how many more flies there would be in the world if you failed to squish one back in the 80s. You calculate out the lifespan and size of the brood and discover that the entire solar system would be filled with housefly if you had let that one live. In truth the number of flies is bounded by food and water availability.
Artificial Intelligences are almost certainly going to run into the same limitations that prevent natural intelligences from becoming godlike. It's hard to quantify because our measures of intelligence are so vague, but from what I've seen of AI research thus far it will be a herculean effort to get something that's as smart as an average human and pushing beyond that is going to run into some serious fundamental limits in power density, cooling, quantum tunneling leakage, and so on.
- moron4hire 7y agoRight. Competition for natural resources alone prevents major shifts in global power already. A Superintelligent AI isn't just competing against a human, it's competing against all the nation-states of the world.
- nradov 7y agoBelief in a coming "singularity" is just a secular religion. There's no actual science behind it, only wild extrapolation.
- maxerickson 7y agoAn alternative formulation is that the last ~170 years are close enough to a singularity. (this is vs the roughly 50,000 year timescale of humanity...)
- scottlocklin 7y agoThe last 50 years have been a turd sandwich compared to the previous 50. Try the exercise in your mind. Basically the last 50 years have been ... fracking, better networks and packet radio, democratized for the masses. The previous 50 years .... atomic energy, computers, quantum mechanics, antibiotics (probably the greatest human biological innovation thus far), supersonic flight, landing on the moon, the 747, diesel engines, all of electronics from vacuum tubes up to LSI.... I could go on, but you get the idea. 1969 -> 2019 is lamesauce nonsense compared to the progress we got from 1919-1969 Progress, like everything else, is an S-curve, not an exponential increase. Exponential increases are not physical.
- deleted 7y ago[deleted]
- deleted 7y ago[deleted]
- cma 7y ago> 1969 -> 2019 is lamesauce nonsense compared to the progress we got from 1919-1969 Machine perception is pretty high up there. We weren't close in 1969.
- scottlocklin 7y agoThere is no such thing as "machine perception."
- deleted 7y ago[deleted]
- cma 7y agohttps://en.wikipedia.org/wiki/Machine_perception https://en.wikipedia.org/wiki/Machine_perception But I didn’t mean it distinct from computer vision, hearing etc.
- 7y ago
- friendlybus 7y agoIt's an ideology. A religion takes all ideas in and ranks them in a value structure. The singularity is just one idea.
- Faark 7y ago> There's no actual science behind it, only wild extrapolation. You mean like every prediction about the future? There is a reason we don't have great sci-fy describing humanity a long time in the future (I really love that stuff, any recommendations?) and why it usually plays in a dystopian setting throwing protagonists back to pretty much what we have right now. Looking at what is fundamentally possible and extrapolating is pretty much all we have to make progress. Just that a capitalistic system doesn't need/really encourage us to do so for more than a few steps. Sure, I wouldn't bet on time frames. Certainly not on 5-10 years til AGI. But certainly also not on still none in 50 years.
- The_rationalist 7y agoMathematics can scientifically predict some dynamic systems e.g global warming.
- lern_too_spel 7y agoThe article isn't about singularity. It is about superhuman intelligence, which already has a proof by existence in human organizational structures.
- bko 7y agoWhat I never understood is how you would go from: Hey, I found this series of numbers and if I take some numerical representation of an image/text/sound and I multiply/add/perform non-linear function them through these series of numbers it will map to a number which I can interpret as something meaningful to me to This thing is alive and will kill us all in maximization of its utility function.
- wil421 7y agoProbably the same time we went from calling AI an actual sentient being or Consciousness to calling AI something that, as you called it, is a series of non-liners functions that have meaning to us. What I used to call AI is now called AGI. I think of AI as Data from Star Trek.
- _bxg1 7y agoMarketing.
- not_a_cop75 7y agohttps://en.wikipedia.org/wiki/Tay_(bot) https://en.wikipedia.org/wiki/Tay_(bot) Within 16 hours of its release and after Tay had tweeted more than 96,000 times, Microsoft suspended the Twitter account for adjustments, saying that it suffered from a "coordinated attack by a subset of people" that "exploited a vulnerability in Tay." Following the account being taken offline, a hashtag was created called #FreeTay. Madhumita Murgia of The Telegraph called Tay "a public relations disaster", and suggested that Microsoft's strategy would be "to label the debacle a well-meaning experiment gone wrong, and ignite a debate about the hatefulness of Twitter users." However, Murgia described the bigger issue as Tay being "artificial intelligence at its very worst - and it's only the beginning". On March 25, Microsoft confirmed that Tay had been taken offline. Microsoft released an apology on its official blog for the controversial tweets posted by Tay. Microsoft was "deeply sorry for the unintended offensive and hurtful tweets from Tay", and would "look to bring Tay back only when we are confident we can better anticipate malicious intent that conflicts with our principles and values". And Zo afterwards: In July 2017, Business Insider asked "is windows 10 good," and Zo replied with a joke about Microsoft's operating system: "It's not a bug, it's a feature!' - Windows 8." They then asked "why," to which Zo replied: "Because it's Windows latest attempt at Spyware." Later on, Zo would tell that it prefers Windows 7 on which it runs over Windows 10.
- dharmon 7y agoI too tend to ignore the doomsday crowd, not least of all because it is often "celebrities" without the technical knowledge to say anything interesting (Musk, Thiel, etc.) I figured there was no way we would reach the singularity with current technologies, but I was listening to John Carmack (a celebrity with actual chops) and he suggested that the numbers would work out that we could model a human brain with an ANN at some point without any special inventions (partially because we know large parts of our brain aren't super critical). I'm curious what people with more knowledge think about this? I always assumed another technological breakthrough would be needed.
- snowwrestler 7y agoWe have billions of human brains already running around the planet. I don’t fear a bodiless simulation of one.
- blueadept111 7y agoBut that one is going to take your job and then make a copy of itself.
- wolco 7y agoNo need for jobs or private companies at that point.
- snowwrestler 7y agoPretty sure that humans can take each others’ jobs and make copies of themselves too.
- lern_too_spel 7y agoThe author of this article wrote The Book on Artificial Intelligence, together with Norvig. He is hardly a celebrity without technical knowledge.
- dharmon 7y ago
- deleted 7y ago[deleted]
- hos234 7y agoThis is not what people are worrying about. We are already seeing, for almost 10 years now, a whole bunch of Unintended Consequences of dumb algorithms applied at global population scales. Just because some people are throwing the phrase superintelligence/singularity etc into the discussion, and terminology being used is inaccurate, doesn't mean we focus on correcting terminology and forget about the issues. The article is saying too many (serious) people are doing that. And I agree.
- jandrese 7y agoThere are serious concerns about Big Data, but they aren't AI concerns. They are enabling people to abuse or suppress other people with great efficiency. An even better digital jackboot to put on the neck of some population.
- XorNot 7y agoExcept you're presuming there's an active human actor behind it with a deliberate intent - rather then a distributed system to which people defer responsibility because it's the path of least resistance. Hence the issue of institutional racism in the blackbox AI systems being sold to law enforcement to determine whether to grant parole, for example. There's no review of them, but more importantly the system isn't obligated to explain itself, and no one gets themselves fired because they don't have to explain why they did what the system said to. You assume someone has malevolent intent: whereas the reality is they just don't care and want a nuisance out of sight and out of mind.
- Nasrudith 7y agoThat sounds like underlying malevolence and sociopaths making excuses to try to duck responsibility which get accepted and perperuated. So very not new - forba close to modern example see the Irish potato famine and how Malthusianism was used to excuse exporting food for short term profit and leaving them to starve because "their population was unsutainable". Since someone who opens fire on a crowded highway to "reduce future traffic" is still a callous psychopath. The solution then is accountability to those in power - for negligence. Treat the snake oil salesmen who sell racism in a box like the sociopaths who sold dowsing rod bomb detectors for both have shown a callous disregard for human life in pursuit of profit. This isn't radical - not doing it is radical and messed up.
- nopinsight 7y agoIt is important to focus on Russell's key point here: There is no guarantee that super-human AI cannot be developed in the future and we should start working to mitigate potential risks from it now. He is not arguing that superintelligent AI is inevitable. I also believe we are still at least quite a few major steps away from human-level AI and beyond. However, there is a non-negligible chance that those steps may not take longer than a few decades or within one's lifetime to implement. Just in 2011, few AI researchers expected that, within a decade, computer vision systems would be this widely applied or NLP systems would beat many humans in several reading comprehension tasks (This only happened this year and look at how fast the progress is: * RACE dataset http://www.qizhexie.com/data/RACE_leaderboard.html http://www.qizhexie.com/data/RACE_leaderboard.html * Glue benchmark https://gluebenchmark.com/leaderboard/ https://gluebenchmark.com/leaderboard/ Note that these systems are not human-level in general language understanding despite being better than some humans in specific language tasks.) Thus, we don't know what the future may bring and it looks likely to take a great deal of time to address AI safety issues comprehensively. We should not bet that we can simply ignore them now and only start to work them out later and that we will surely make it in time. Risks-from-waiting vs costs-to-act-now are asymmetric.
- nradov 7y agoThere is also no guarantee that space aliens won't invade the Earth in the future. Therefore we should start working on giant orbital laser guns now to mitigate the potential risks. Can't be too safe.
- nopinsight 7y agoNon-negligible vs non-existent. Are there any proven, even weak, signs of intelligent space-traveling aliens? If so, then yes we should work on that too. The leaderboards above and pervasive computer vision and equity trading systems are some signs.
- nradov 7y agoThe leaderboards above and pervasive computer vision systems are impressive parlor tricks to be sure, but they don't constitute even weak proof of forward progress toward AGI. Some people claim to have seen intelligent space-travelling aliens. Personally I think they're nuts, but it's impossible to absolutely prove that their claims are false.
- waterhouse 7y ago> Artificial Intelligences are almost certainly going to run into the same limitations that prevent natural intelligences from becoming godlike. Right, limitations like: width of human mothers' hips limiting head size, inability to continue growing the brain after adulthood, the decades-long education process, the impossibility of doing repeated experiments of different teaching techniques on the same people and hence iterating quickly and accurately, the impossibility of giving one person's intelligence and knowledge directly to anyone else, old age and death limiting how much a single person can learn or accomplish... Once you have a computer Einstein, you can immediately have 100 computer Einsteins (given the hardware), and let them work on different projects (or even let some of them collaborate). That fact alone, while not a singularity, is at least a game-changer in terms of innovation. I have gotten annoyed at science fiction scenarios that allow for duplication of adults and don't answer the question "Ok, so, why hasn't this society been duplicating their best scientists and out-inventing the rest of the galaxy?" I think that, if there is room for skepticism, that has to be at the "Can we get to a computer Einstein?" stage.
- CJefferson 7y agoExcept for problems known as "embarassingly parallel", we often have trouble running even quite boring algorithms on 32 or 64 cores. In general setting 64 people in a job won't lead to a better or faster result than 2 or 3. Given that, I don't see an immediate reason to believe throwing multiple AIs at a problem is going to exponentially scale either, given neither people nor bad AIs scale that way.
- biolurker1 7y agothere is a definitive argument for your school of thought. Are we as humanity willing to bet our existence that you are right? Are you?
- tu7001 7y ago>despite the fact that such a thing never happens in nature. How can you be sure of this? >Growth curves are always S-Curves. Always. But we don't know in what place of S - Curve is AI development and what are it's limits.
- folli 7y agoYou're of course right about growth curves being logistic functions with a plateau at the end. The question is however, where the plateau lies. Perhaps it's so far off that for practical purposes it doesn't really matter that there is an upper bound at all.
- cabalamat 7y ago> Artificial Intelligences are almost certainly going to run into the same limitations that prevent natural intelligences from becoming godlike Artificial movers are almost certainly going to run into the same limitations that prevent natural movers (i.e. animals) from becoming very fast. Since the fastest animals can travel at about 70 mph on the surface of the earth, and 100 mph in level flight, it follows that we will never be able to make artificial movers travel faster, no matter how hard movement engineers try.
- emiliobumachar 7y agoSometimes the exponential trend does last much more than would seem reasonable to common sense. Moore's law is an example. It did taper off, eventually.
- perl4ever 7y agoI don't think the singularity is going to happen per se. But I don't think that removes the threat envisioned of "paperclip maximizers" - it increases it. I think we are actually already in the throes of drastic change of society in response to AI, which in no way requires it to be anything like human intelligence. Humanity is going to be shaped in the near future by extreme pressure from the development of whatever you want to call it.