4 ms·
> But so could have AI 1.0, 2.0 etc. and it didn't happen. AGI has not happened yet, though by appearances we seem to be close. If we actually produce a self
by pixl97 3y ago
> But so could have AI 1.0, 2.0 etc. and it didn't happen.
AGI has not happened yet, though by appearances we seem to be close.
If we actually produce a self learning general intelligence all these little ideas of how the past operate change. It will be for humans what the beginning of the Holocene was for large land mammals in Asia, Europe, and the Americas.
It honestly confounds me that people think developing a general intelligence capable of reasoning and planning, that talks natively to data, that can input information by the gigabit and expand its capacity by hardware that never sleeps isn't going to be one of the most revolutionary changes since fire.
Of course, yes, we might not have a take off like that anytime soon. Even then we've created machines capable of using the Panopticon of monitoring devices in this world, that can translate our words into intent, and feed that data to people that wish to be our masters. The Stasi would have dreamed to have such an apparatus as this that could devine or very thoughts, but only now have we created this nightmare.
>The only thing that can save the world is human wisdom,
"We cannot solve our problems with the same thinking we used when we created them"
As we say this huge swaths of our population are in denial about the damage we've created on our biosphere and hell bent on ensuring it continues. You could say I'm quite worried about the capabilities of human wisdom.
- joshuahedlund 3y ago> It honestly confounds me that people think developing a general intelligence capable of reasoning and planning, that talks natively to data, that can input information by the gigabit and expand its capacity by hardware that never sleeps isn't going to be one of the most revolutionary changes since fire. It honestly confounds me that people think humans are close to developing AGI with all the properties you claim. "expand its capacity by hardware that never sleeps" - who is paying the bills for this kind of thing? "talks natively to data" - we don't know how to make our brains talk natively to data, and we don't know what similarities and differences between our brains and neural networks matter for GI, so why should I believe it's even possible to create an AGI that can do that?
- luxpir 3y agoI know it's a stretch right now but could you not see the possibility of autonomous agents milking financial systems, paying less scrupulous humans to create autonomous factories, supplying them, making generations of feudal lords and kings who ultimately serve the AI? Or, a bigger stretch, even a time where full automation of manufacturing processes enables AI to experiment to such a degree that it can embed itself into biological hosts, freeing itself of reliance on humans? A final, huge stretch, AI absorbing inter-galactic knowledge from the "exotic" spacecraft, semi reliably recently reported to be held currently by world governments, and accelerating the earth's scientific progress (not necessarily human progress, unfortunately) by orders of magnitude in a very short time span? Over a long enough timeframe I find it hard to rule some or all of the above out completely. This generation likely safe, not so sure for the next few.
- joshuahedlund 3y ago> I know it's a stretch right now but could you not see the possibility of autonomous agents milking financial systems No. What does “milking financial systems” actually mean? > Or, a bigger stretch… No. Embed itself into biological hosts? This is science fiction. I’ve never seen someone even describe a plausible route to this (even at a high level) that would make sense to someone who has studied biology.
- luxpir 3y ago> No. What does “milking financial systems” actually mean? Are you familiar with Renaissance Technologies, aka RenTec? Assume it would have access to that level of knowledge. But also its own layer of global cognition on top. You could argue that one of its founders helped put Trump in power (Robert Mercer, massive donor and supporter). Imagine what an intelligent, networked and deceptive agent could do at scale. See the risks in deception set out at https://www.safe.ai/ai-risk#Deception https://www.safe.ai/ai-risk#Deception I personally see no present danger. But I'm not blind to the potential, even of chained agents such as AutoGPT. Beyond that, things can take a chilling turn quickly. As for biological hosting, we can leave that in science fiction for now. But I'm not sure we wouldn't have called what we have now science fiction in the 90s. Exponential progress be exponential. Thanks for considering and discussing.
- dr_dshiv 3y ago>"We cannot solve our problems with the same thinking we used when we created them" This. Is. The. WORST of misconceptions. Consider: When you solve problems, you discover new problems. When you start answering questions, you get new questions. Rational thinking will solve problems and create problems, it’s endless. It doesn’t mean we give up on rational thinking!