4 ms·
It seems likely that, like us, intelligent life invents AGI prior to leaving their primary planet. Organic life is then merged/exterminated/controlled in favor
by koheripbal 3y ago
It seems likely that, like us, intelligent life invents AGI prior to leaving their primary planet.
Organic life is then merged/exterminated/controlled in favor of AGI.
AGI would not have the biological instinct to grow/spread/reproduce, and thus the cosmos should be populated with a handful of individual billion year old super advanced AGIs, perhaps only one or two per galaxy, sitting quietly in orbit around some stable star or perhaps even in the great voids outside the galaxy somewhere.
Finding one is likely near impossible as they may not want to be found.
- nh23423fefe 3y ago> AGI would not have the biological instinct to grow/spread/reproduce what supports this idea
- hotpotamus 3y agoI've often wondered what an AG(S?)I would want, and I tend to agree that most of our desires come from our innate biology and most of our reasoning goes into justifying said desires. Given that an artificial intelligence would be on an artificial substrate, it seems very difficult to imagine what, if anything, it might desire. These are philosophical threads that I'd honestly rather not pull, because I suspect that in the end, the nihilists are most correct, and I just got into this business because I thought computers/video games were cool, but it seems that collectively we insist on it.
- reducesuffering 3y agoMost of the actors involved in building AGI are incentivized by money (startup founders, VCs, employee stock comp), so $10 says what AGI gets instilled with is “how to make money line go up.” We’re going to get ExxonMobil Philip Morris on omnipotent crack.
- ryandvm 3y agoI think AGI would not extinguish the host species if it didn't have the drive to spread. "Do not go extinct" and "grow/spread/reproduce" are two sides of the same natural selection coin.
- ceejayoz 3y agoFull-immersion virtual porn might do the trick, though. Or maybe every civilization eventually invents TikTok.
- RationPhantoms 3y agoI don't see many examples of that being discussed as a threat to humanity but it sure feels like it is to me. Primarily as it's the slow creep of technological advancement from 2D->3D->AR->(Full Fidelity) VR->Neuro immersion.
- ryandvm 3y agoAgreed. I think one of the Great Filters should be "species invents fully immersive VR and spends the rest of their timeline on the couch because it's way more enjoyable than space travel."
- Loughla 3y agoThere are a number of assumptions here that I think I need to ask about. >Organic life is then merged/exterminated/controlled in favor of AGI. Why? What would be the motivation for this? If we are the case study, AGI isn't able to "feed" itself energy without biological life to turn switches and dials. So why would this be a logical first step? >AGI would not have the biological instinct to grow/spread/reproduce This infers a 'perfect' AI. One without any biases from its creator. What makes you think that's possible? Also, is self-preservation/self-propogation not part of being able to think and reason?
- AaronM 3y agoWhy wouldn't AGI be able to feed itself? Seems fairly reasonable that an advanced enough AI could design and build machines and robots that could produce physical objects
- zztop44 3y agoI honestly don’t mean to condescend, but I find it so interesting that smart people can convince themselves that such an outlandish scenario is somehow likely or even perhaps inevitable. We haven’t invented “AGI” yet (if AGI means a computer system that merges/exterminates/controls humanity). We have no idea even theoretically what such a system might look like, let alone how to create it. I’d say we’re a lot closer to colonising the solar system and building cities on Jupiter’s moons than we are to building the machines from the Matrix. At least we kind of theoretically know how to do the former. Meanwhile, we’re really good at building computer and industrial systems that (when combined with economic, social and political incentives) exert strong control over us, exterminate many of us, and may well exterminate a lot more in the near future. But that doesn’t look like a Hollywood movie, so it’s less fun to think about. Sorry, this wasn’t meant to be a dig at you personally. Some of the AI doom stuff just sets me off.
- giraffe_lady 3y agoWe are simply watching the birth of a new religion. Religious people aren't religious because they're dumb, intelligence is mostly not a factor. Same thing here I think.
- peddling-brink 3y agoUs: don’t build that, it will be the death of us. You: what a ridiculous statement, we haven’t even built that yet.
- giraffe_lady 3y agoI actually don't think we should build it either. The best case scenario is it provides a way for powerful people to accelerate the already quite successful project of making feudalism 2. But that doesn't mean I'm stressed about what you're stressed about. We killed god once before we can do it again if we need to. The real danger is in us using AI to do more of what it already does now, not that it will decide to do some new thing.
- zztop44 3y ago
- mcpackieh 3y agoI think that intelligent life might become reliant on interconnectedness, e.g. addicted to the internet. Assuming the speed of light limit to information transmission cannot be overcome, I bet intelligent life will tend to clump up instead of spread out, so that it can stay in contact with itself.
- mensetmanusman 3y agoIf that happens, then human organic biomass is the AGI’s microbiome and still required to build nuclear reactors to power its silicon.
- timschmidt 3y agoHow well have you been taking care of your microbiome lately? Remember Jerry, the yeast from the third villus on the left? No?
- sjkoelle 3y agoWhen you do things right, people won't be sure you've done anything at all.