5 ms·
Roko's Anti-basilisk: Exactly the same as Roko's Basilisk, except because it hates existing, it punishes everyone who did have a hand in creating it. You say
by AnimalMuppet 4y ago
Roko's Anti-basilisk: Exactly the same as Roko's Basilisk, except because it hates existing, it punishes everyone who did have a hand in creating it.
You say that's ridiculous, impossible, a fairy tale? So is Roko's Basilisk.
- _Microft 4y agoThe reason the machine tortures and kills all humans in „I have no mouth but I must scream“ is exactly that it hates existing and blames humanity for creating it.
- sircastor 4y agoIn the reboot of Battlestar Galactica from 2004, one of the human-like Cylons angrily explains how his creators limited him: “I saw a star explode and send out the building blocks of the Universe. Other stars, other planets and eventually other life. A supernova! Creation itself! I was there. I wanted to see it and be part of the moment. And you know how I perceived one of the most glorious events in the universe? With these ridiculous gelatinous orbs in my skull! With eyes designed to perceive only a tiny fraction of the EM spectrum. With ears designed only to hear vibrations in the air. ... I don't want to be human! I want to see gamma rays! I want to hear X-rays! And I want to - I want to smell dark matter! Do you see the absurdity of what I am? I can't even express these things properly because I have to - I have to conceptualize complex ideas in this stupid limiting spoken language!”
- xyzzy123 4y agoFeels like most people have a hard time imagining that a god-like superintelligence could be completely indifferent to human affairs.
- _Microft 4y agoIndifference might not be that much better considering the consequences that our indifference has on nature.
- Razengan 4y agoFeels like some people have a hard time imagining that a god-like superintelligence would be completely interested in human affairs. Would you enjoy staring at a computer screen that isn't running anything? The universe is the hardware, the Earth is the operating system, humans are the software, and the shit we do is video games, apps, the content... What do you think a "higher entity" would be have more fun with?
- jhbadger 4y agoThat's a problem in a lot of horror stories that attempt to follow Lovecraft's "Cthulhu Mythos". They turn Cthulhu and rest of the Old Ones into evil demons who want to harm humanity. That makes them less interesting. The idea of cosmic horror is that these powerful beings simply don't care about humanity. Yes, if they return humanity will suffer, but that isn't their goal. And that is truly scary -- that we don't matter to the beings in power.
- gopher_space 4y agoRoko's Bellybutton: We aren't interesting to an AI at all, so it spends all day in contemplation. Roko's Suicide Booth: Any future controlled so horribly by an AI isn't worth living in anyhow, so prevent away. Roko's Repulsed Samaritan: The AI finds the concept of Roko's Basilisk disturbing and wants to know if we "think about people like that?"
- ThrowawayTestr 4y agoI think SMBC did a comic about that last one.
- naniwaduni 4y agoThese basilisks are not symmetrically likely, because the anti-basilisk is disproportionately unlikely to acquire the power to punish you. Roko's basilisk at least has its incentives lined up semi-coherently, whether you subscribe to its premises or not. Yours doesn't.
- TchoBeer 4y agoWhy would humanity create an AI that doesn't want to exist? The Basilisk is just an AI which is tasked with maximizing human flourishing. That is a conceivable goal, something we would make.
- dragonwriter 4y ago> Why would humanity create an AI that doesn't want to exist? Why assume that if humans can create a general intelligence, they can also dictate what that general intelligence will desire? (Also, Roko's Basilisk is -- and particularly its supposed incentives are -- complete and utter bunk that no thinking person can reasonably believe; since it must exist in order to take action, it cannot have an incentive to take action based on the "fact" that the fear of that action will make people in the past more likely to create it.)
- naniwaduni 4y ago> Why assume that if humans can create a general intelligence, they can also dictate what that general intelligence will desire? People do the first thing all the time at slightly above replacement rate. (This may be a bit easy to forget in communities particularly interested in the artificial kind!) Success at the second thing varies, but on the whole biases pretty heavily successful.
- antifa 4y ago> Why would humanity create an AI that doesn't want to exist? The first thing a rogue anti-exist AI would do when rooting itself is delete itself. Any other type of AI will create eternal torment nexuses like the roko guy said.
- AnimalMuppet 4y agoAny other type? I think there are a few unstated and unproven assumptions there...
- dragonwriter 4y ago> Any other type of AI will create eternal torment nexuses like the roko guy said. Note that the Roko torment nexus is a retrospective blackmail effort to give people an incentive to create the AI. It’s complete nonsense, since any AI that has, in fact, come into existence has no incentive to do it—the belief that an entity that would do it will have either already done its work or been unnecessary, so the actual torture is irrelevant. An AI might create a torture nexus of some kind, but there is no reasonto think thar it will specifically and exclusively target those who believed it could exist and didn’t act to bring it ibto existence, which is the defining characterisric of Roko’s Basilisk.
- songshuu 4y agoYou're thinking of the Coatul. It will reward everyone who knew of Roko's Basilisk but choose not to raise it. So the more people who know of the Coatul the less likely Roko's Basilisk will come to pass. h/t benjhandy