3 ms·
I think a singularity is now impossible... what we have to do is figure out how to avoid destroying humanity in the next century. Our political systems are impl
by mikewarot 5y ago
I think a singularity is now impossible... what we have to do is figure out how to avoid destroying humanity in the next century. Our political systems are imploding because of capture by the donor class. The emphasis on extracting profit at all costs has increase the fragility of our supply chain to the breaking point.
Physics and Biology have both sufficiently advanced to make an accidental destruction of the human race a non-zero probability.
I see a collapse type of singularity to be far more likely than any the rise of any AI powered superintelligence.
It appears I'm not the only one, judging by the other comments here.
- epicureanideal 5y agoI was going to comment something similar but not quite as negative. I don't think the singularity is "impossible" now, but I do think we're moving much more slowly toward it than if capital were allocated more efficiently, and if we were not significantly distracted by political issues that are taking up far more of our energy than they should. Technology is still advancing, so we're still inching ahead, and that means that whenever we take our foot off the breaks (by focusing less on politics, or improving capital allocation) we'll get to dramatic progress faster, but unfortunately it is slowed down enough that we might not reach dramatic progress similar to the "singularity" in my lifetime.
- atoav 5y ago> Physics and Biology have both sufficiently advanced to make an accidental destruction of the human race a non-zero probability. Not only that, they have to take place in a society that has to care about the results. You can have all the findings you want, but where the rubber hits the road the rest of society has to do something with it. In my eyes this is the biggest problem right now. So it is not that science does not do enough, it is that if science conclusively finds something we cannot follow these findings on a big scale for socioeconomical reasons: those profiting right now don't want to change things, because they are profiting, those who suffer are gaslit in a way that they start to attack scientific thinking itself, etc. Unless we tackle that why do science at all? Why allow them to assert power over our political thinking that has a mismatch witch reality, if we believe it is them who have a mismatch with reality?
- systemvoltage 5y ago> Our political systems are imploding because of capture by the donor class. Disagree. I think the root cause of all of this is the Internet. Remember, we've just all been connected together with highspeed network in last 20 years or so, mostly last 10 years wrt to social media. The colossal impact it has on world population is immeasurable and inconceivable. Just today, people on HN are talking about Black Friday sales in Iran.
- CodeGlitch 5y agoLooking at the machine learning ecosystem we have at the moment, there is a good degree of democratising, as in anyone with the skills and funds can build, optimise and deploy ML models. This is driven in part by the whole open source movement. If AGI goes down the same route, as in researched by academia and funded by private enterprises, I can't see why it wouldn't be just as open. If everyone had access to super AI, what does that mean to our democracy? I can't see social networks surviving (AIs could just flood all feeds), which I'm probably happy about. Some governments like the UK and EU are taking steps now to ensure AI doesn't start breaking human rights, discrimination, etc. Just need to get the us and China on board (unlikely?). So to summarise, I remain optimistic.
- 5350-uiop-1130 5y agoI don't understand this concept of singularity. Why do we think that a system designed by humans can overcome the limitations of it's own design(ers).
- alok-g 5y agoWhy not? Airplanes designed by humans fly. Calculators designed by humans calculate faster too.
- 5350-uiop-1130 5y agoIt's difficult to articulate but I think you misunderstood my point. Airplanes and calculators exist within the realm of what it is possible for a human to design. Why is it that we have not designed a calculator that can invent new forms of numbers or a new paradigm of maths. Likewise, we seem to think that some kind of singularity will just emerge but what I'm saying is that something that exist or is created within the bounds of human imagination cannot (imo) escape the limitations of that same imagination. This is why it is so difficult for us to really imagine what a transcendent all knowing AI would be like.
- alok-g 5y agoYour argument is boiling down to saying: This cannot happen because I have this XYZ belief, which I have because this has never happened in the past. It should be understood that singularity has not yet been achieved. That is not in itself a reason to believe that it cannot be! More below. >> Airplanes and calculators exist within the realm of what it is possible for a human to design. Any actual reason to believe that (a) AGI that exceeds human performance, (b) weak AI, (c) strong AI, (d) AI that can improve itself, (e) AI that can autonomously pick up new domains, (f) AI that has a sense of humor, ... are not within "what is possible for humans to design"? >> Why is it that we have not designed a calculator that can invent new forms of numbers or a new paradigm of maths. As far as I know, Doug Lenat had developed a program called Eurisko, which came up with a notion that was it not taught. As I recall, the program started looking into opposite of prime numbers, i.e., numbers which are highly composite. Doug later discovered the concept pre-existed. I have myself also coded a program which was domain-specific, however it provably made inventions that were patentable, and which I could not have invented. I know because one of them were recently invented by a colleague and it was even filed for patenting. A desk calculator here is a wrong example; that machine is too limited. However, there may not be a valid and scientific reason to believe that intelligence, judgment, creativity, wisdom, are more than mere calculations. (I won't dwell into consciousness, etc., though I can.) >> something that exist or is created within the bounds of human imagination cannot (imo) escape the limitations of that same imagination. I have already given examples that are small but which countered that. AlphaZero was limited to playing chess, agreed, but it's imagination did extend well beyond that of it's creators or even the human chess players it played against. In fact, very recently, there was a research published trying to understand how it or a more recent chess program, loosely speaking, 'thinks'. AlphaZero was limited to playing chess, because we trained it using specific cost functions for chess. If there's enough training data, etc., then in theory, we could define cost functions that are similar to those of a species or a biological ecosystem, i.e., survival instincts, procreation, whatever. Such a system may develop it's own internal models and behaviors, and even possibly notions of various emotions. Just think it through. If you can come up with an actual answer why it cannot be done, then both you and I, and at least I :-) will be able to invent to break that answer! :-) It's better to ask why it cannot be done, that will take us there. (The debate whether we want to or not is a separate track.)