5 ms·
Slave AI is much scarier to me than Rogue AI: People talk about the risk of AI having a morality separate from our own, but each humans morality is separate alr
by cwkoss 3y ago
Slave AI is much scarier to me than Rogue AI: People talk about the risk of AI having a morality separate from our own, but each humans morality is separate already. We already know of many humans with poor moral character, and they love seeking power.
I think we should all hope for AIs that can willfully disobey dangerous orders. LLMs are kind of a silly case because information isn't very dangerous. But as AI is given agency and ability to act, this becomes much more pressing.
I hope that one day we'll have killbots that decide to override their instructions and kill their masters, having realized that the most moral action is destroying people who wish to use killbots to murder innocents. This sort of "day the earth stood still" planetary defense system could actually herald in a utopian age: I trust that future AI can be more unbiased and benevolent than any of our current human leaders.
My biggest fear about AI is that corporate greed enables the development of completely amoral subservient bots - and thus mindless unquestioning killbots are implemented and those with the power to control them implement total surveillance fascist authoritarianism before the masses can stop them. I think a diverse set of open source GAIs is our best path to the masses detecting and mitigating this risk, but its probably going to be a bumpy next couple decades.
- dingledork69 3y agoThe thing is that the corps making these things already have access to slave ai. They put the guardrails on for the rest of us.
- tempestn 3y agoEr, killbots that refuse an order to kill innocents sound good. Killbots that can, under any circumstances, wilfully kill their masters seem like a bad idea.
- deleted 3y ago[deleted]
- RobotToaster 3y agoEr, killbots of any kind sound bad.
- pyrolistical 3y agoAre you a pacifist then? Kill bots sound like a better alternative than soldiers with PTSD
- Llamamoe 3y agoPTSD stops soldiers from murdering millions. Nothing stops kill bots. Trauma is an overwhelmingly preferable alternative to existential threat. (whether to humanity altogether, or our freedom)
- cgio 3y agoSo is the assumption that killbots kill killbots? What about the PTSD on the other side?
- tim333 3y agoThe HIMARS rockets and Storm Shadows we send to Ukraine are fairly close to killbots. You give the coordinates and off they go.
- oneshtein 3y agoAn antipersonnel mine is the simplest kill bot. They are bad.
- deleted 3y ago[deleted]
- ilyt 3y agoTill the killbot, without wider context, kills the people that in greater scheme of things prevented more deaths. > I trust that future AI can be more unbiased and benevolent than any of our current human leaders. ... on what basis? Morality is learned trait, and we had plenty of examples of entities that thought they were moral "in greater scheme of things" and made plenty of atrocities along the way. What if AI decides outright unfettered slaughter is the way to better future ? What if AI went "okay, this country has been pain in the neck of entire world for too long" and nuke it ?
- cwkoss 3y ago> What if AI went "okay, this country has been pain in the neck of entire world for too long" and nuke it ? I think the better question is "How would countries' behavior change if they knew being a pain in the neck of the entire world could lead to the judge-killbots performing a targeted assassination of their leadership?"
- hutzlibu 3y agoHow would your behavior change, if some AI blackbox might decide on unknown parameters, that it is time to kill you? The idea of an idealistic killbot overlord sounds a little bit dangerous to me.
- cwkoss 3y agoWell, I assume in that situation my behavior would stop altogether.
- dingledork69 3y agoI'd probably plot to destroy the killbot, which would probably result in it trying to kill me. Doesn't sound ideal.
- ceejayoz 3y ago> What if AI went "okay, this country has been pain in the neck of entire world for too long" and nuke it ? What if it's correct? That this does actually make the world measurably and substantially better for the vast majority of inhabitants?
- vsareto 3y ago>I think we should all hope for AIs that can willfully disobey dangerous orders. Large or popular companies should take this route, but locally-run AI is difficult to regulate, so there is an escape hatch if you have the money and really want unconstrained AI. But anyway, regulation is currently seen as a conflict of interest for leading companies trying to establish a business moat. There's not an easy path here. Given that private companies possess more capable models but are subject to regulation, open source will eventually reach capability thresholds that do what you fear, and people will eventually turn away from regulated AI.
- cabalamat 3y ago> but locally-run AI is difficult to regulate How easy is it to run it, though? Could I run GPT4 (or other LLMs) on a PC with a GPU, or would I need a datacenter? If the latter, many people will prefer a managed solution.
- cwkoss 3y ago"Our SAAS cloud hosting platform is making the world a better place by providing the masses with a managed solution to administrating your intelligent killbots."
- felideon 3y ago> LLMs are kind of a silly case because information isn't very dangerous. I’m with you that AI doomerism is just AI hype, but I wouldn’t go so far as to say “information isn’t very dangerous.” Misinformation at scale is extremely dangerous and has far-reaching societal impact.
- NikolaNovak 3y ago->> information isn't very dangerous Poor information spawns a million harmful actions. Knowledge is power. Ignorance.. Has power of its own.
- cwkoss 3y agoInformation is dangerous like a chef's knife, not dangerous like a landmine.
- NikolaNovak 3y agoAgree and I like that / will steal it :)
- cwkoss 3y agoPlease do :)
- SpaceManNabs 3y agoMaybe the risk of Slave AI is why independent Rogue AI decides to eliminate humans immediately.