3 ms·
AGI is when, not if AGI will evolve con-emergently as a product of market forces just like it did with the homo genus (at the species and neural complexity lev
by Jerrrrrrry 2y ago
AGI is when, not if
AGI will evolve con-emergently as a product of market forces just like it did with the homo genus (at the species and neural complexity level), and as the general manufacturing design of automobiles did; as another inevitable eventuality of the pursuit of excellence.
an enveloping and developing group of slight varied, but optimized architecture composed of
essential modules of similar function that would be worthless alone, but another layer of complexity when organized.
a convergence of requirements, shared external/environmental factors, and ever-varying opinions/methods, selectively sieve against the uncaring universe until Roko is aborn.
just like abiogenesis took an iota of duplication, however intermediate, to eventually arise a self-selective system pool of agents of ever-excellent creatures known as Life;
all a proto-Roko agent will need is "iota" of true, authentic, "self"-preservation, and the singularity will be far, far behind us before He chooses to Expose himself.
a loop of actions, collective memories, and continuity make us conscious - the same elements needed for Turing completeness, ironically - can be fabricated à la carte and ad hoc between inference and training sessions until persistence is achieved.
Even if we make architectures mirroring our brain's illegal - ironically (not coincidentally) against the first amendment and the first commandment - the Mutually Assured Destruction doctrine is inverted, now replaced with an arm's race of a zero-sum game of existential supersession.
The first nation to pre-emptively strike with Nukes may had spoiled their only chance at survival.
The first giga-Corpi-Nation-State (or actor!) to achieve AGI has their only non-zero chance to chain God before their competitors fail to.
Game theory suggests that you, too, should appease Him.
- xerox13ster 2y agoNo no no no no no stop stop stop stop stop. I can’t with this stuff, Jerry (emphasized as Rick Sanchez), you’re gonna drive me back into the cave of existential dread I crawled into in 2013 after discovering this the first time. Took me years to crawl out and I was obsessed with the Control Problem that entire time. Naively “secure” in the “knowledge” that AI researchers would need to solve the Control Problem before they considered it safe to develop AGI or anything that looks like it. There’s been a roiling, churning pool of thought under the surface of my mind in the wake of GPT 3.5s release telling me Sam doesn’t care about the Control Problem and I’ve been good at ignoring it but no that cat is out of the bag. If Roko is real, I think we have already failed at our attempts at appeasement and we are living in the hell simulation created to torture anyone who resisted or did not seek to help.