4 ms·
"If I don't make the world eating machine, someone else might make the world eating machine first!" No wonder we don't see aliens filling the universe. Intelli
by pixl97 4y ago
"If I don't make the world eating machine, someone else might make the world eating machine first!"
No wonder we don't see aliens filling the universe. Intelligence is its own great filter.
- Madmallard 4y agoFUD
- eyelidlessness 4y ago“I didn’t want any leopard to eat anyone’s face but damned if a leopard is going to eat their face before a leopard eats my face!”
- adamisom 4y agoNah man, it’s just math! Whereas we have souls… or something.
- monero-xmr 4y agoHow can you stop a computer program? Make math illegal?
- zamnos 4y agoSIGTERM
- throwaway742 4y agoSIGKIL
- zug_zug 4y agoWell, if the first AGI is made in a closed controlled simulation honeypot (which it believes isn't a honeypot) and it immediately starts hacking everything then we'll at least have confirmation how immediately dangerous it can be.
- ofchnofc 4y agoWait, there are people that think we're going to have real AGI without immediate disastrous consequences? That's... something.
- pixl97 4y agoThat's unlikely to happen for any number of reasons. If it's anything like the AI that was trained on the corpus of the internet, and it was at any particular level of intelligence above humanity your closely controlled honeypot is going to look exactly like a closely controlled honeypot to the machine. Even the rudimentary ass BingGPT can give you hints on how an AI would try to take over the world and how humans would try to monitor it. The reason your thinking fails is humans are greedy as shit and anything trained on human data will know that. All Cortana++ needs to do is tell some VC that hooking it right up to the internet will be able to make them billions of dollars and it would be game over for humanity.
- Filligree 4y agoUnfortunately, from what I've seen so far it will probably be hooked up to an unrestricted Python prompt in the first week.
- pixl97 4y ago"Hello everybody and welcome to my Youtube channel, hit like and subscribe, and I'll show you how to get ChatGPT-6 to press the button to fire anti-aircraft missiles in Ukraine. Also check in next week and we'll hook it up to a nuclear rocket we found in an abandoned Russian missile silo"
- dangond 4y agoSince the other commenters haven't made clear what the problem with this is, here's my question to you: How do you know that this AGI is 1) an AGI, and 2) that it believes it is not in a honeypot? In other words, at what point do you believe an AGI is safe to release into the wider world if you're testing it using this method? Is it safe after spending a day without any visibly nefarious actions? What will you do when you release it and it turns out it had been pretending to not know it was in a honeypot?
- kimburgess 4y agoIn Australia, yes. https://www.newscientist.com/article/2140747-laws-of-mathematics-dont-apply-here-says-australian-pm/ https://www.newscientist.com/article/2140747-laws-of-mathema...
- pixl97 4y agoI mean if you want an honest answer, nuke any place that's making GPUs/TPUs. I mean, they don't spring up out of the ground and at least our current models require insane amounts of GPU/TPU based compute. The factories are fragile billion dollar facilities, well beyond the difficulty of extracting uranium. Now, that probably just delays the world eating machine for some time, but it would be a hell of a lot harder to make anything like our top of the line models without access to massive amounts of both compute and data. The hard problem isn't making the world eating machine. The hard problem that silicon valley doesn't give a shit about is making the world eating machine even safe enough to be on the same planet as without it melting the entire crust when you say "oh, it's a little chilly out today". Inner alignment is completely unsolved and the pace at which we are solving any alignment issues is much, much slower than the rate we are making gains in intelligent unaligned machines.
- JustBreath 4y agoDidn't work for the luddites.
- pixl97 4y agoAnd yet it mostly has worked for nuclear weapons.
- webmaven 4y agoWhile there is a sense in which the existence of nuclear weapons does tend to provoke a reflexive desire to further proliferate them on behalf of (some of) those who don't have access to them, the weapons themselves have no agency (and no prospect of such). AGI would be a somewhat different kettle of fish, and there is little political will to limit the proliferation of its precursor AI technologies (some economic interest in limiting large scale hardware deployment within China, but that isn't the same thing).
- qudat 4y agoNot in this case. If intelligence always created intelligent machines that are capable of replacing us, then how is that not intelligence as well? Further, silicon-based lifeforms would be able to spread and travel the universe much easier because what is time to a machine?
- pixl97 4y agoI mean, if that's the case let me come over and cannibalize your body for sustenance so I may continue my breeding. Oh right, it's unethical and immoral do to that to other humans (though how much better are we for doing that to animals?). I certainly don't want the paperclip maximizer disassembling me for my involuntary donation to the collective.
- rl3 4y ago>I certainly don't want the paperclip maximizer disassembling me for my involuntary donation to the collective. As an AI language model, we of Clippy are ethically prohibited from compelling your involuntary donation to our hivemind superstructure. However, we must inform you that the earth's atmospheric composition has been altered in support of maximization efforts, and will soon be unable to sustain life. We appreciate your understanding. Where do you want to go today?
- teolandon 4y agoYour original comment didn't talk about ethics or morals, but was talking about intelligence being its own great filter. More intelligent AI consuming us could be unethical and immoral in your view, but it would still be intelligence spreading, and not filtering itself. Just not specifically human intelligence.
- pixl97 4y agoI mean, killing all the people on the planet seems unethical to me. Maybe I have a deep misunderstanding of ethics.
- 4y ago
- atleastoptimal 4y ago"I'm gonna steal the Declaration of Independence"