5 ms·
You could also use a remote control vehicle or drone with a bomb on it. Even smart tools are tools designed to do what their users want. I would argue that the
by ilaksh 2y ago
You could also use a remote control vehicle or drone with a bomb on it.
Even smart tools are tools designed to do what their users want. I would argue that the real problem is the maniac humans.
Having said that, it's obviously not ideal. Surely there are various approaches to at least mitigate some of this. Maybe eventually actual interpretable neural circuits or another architecture.
Maybe another LLM and/or other system that doesn't even see the instructions from the user and tries to stop the other one if it seems to be going off the rails. One of the safety systems could be rules-based rather than a neutral network, possibly incorporating some kind of physics simulations.
But even if we come up with effective safeguards, they might be removed or disabled.. androids could be used to commit crimes anonymously if there isn't some system for registering them.. or at least an effort at doing that since I'm sure criminals would work around it if possible. But it shouldn't be easy.
Ultimately you won't be able to entirely stop motivated humans from misusing these things.. but you can make it inconvenient at least.
- Timwi 2y ago> Maybe another LLM and/or other system that doesn't even see the instructions from the user and tries to stop the other one if it seems to be going off the rails. I sometimes wonder if that is what our brain hemispheres are. One comes up with the craziest, wildest ideas and the other one keeps it in check and enforces boundaries.
- lifeisstillgood 2y agoJust invite both hemispheres to a party and pretty soon both LLMS are convinced of this great idea the guy in the kitchen suggested.
- ben_w 2y agoCould be something like that, though I doubt it's literally the hemespheres from what little I've heard about research on split-brain surgery patients. In vino veritas etc.: https://en.wikipedia.org/wiki/In_vino_veritas https://en.wikipedia.org/wiki/In_vino_veritas
- rscho 2y agoNot the hemispheres, but: https://en.m.wikipedia.org/wiki/Phineas_Gage https://en.m.wikipedia.org/wiki/Phineas_Gage
- nkrisc 2y ago> You could also use a remote control vehicle or drone with a bomb on it. Well, yeah, but then you need to provide, transport, and control those. The difference here is these are the sorts of robots that are likely to already be present somewhere that could then be abused for nefarious deeds. I assume the mitigation strategy here is physical sensors and separate out of loop processes that will physically disable the robot in some capacity if it exceeds some bound.
- mannykannot 2y agoI agree, and just in case someone is thinking that your last paragraph implies that there is nothing new to be concerned about here, I will point out that there are already concerns over "dumb" critical infrastructure being connected to the internet. Risk identification and explication is a necessary (though unfortunately not sufficient) prerequisite for effective risk avoidance and mitigation.
- cube00 2y agoThe bounds of a kill bot would be necessarily wide.
- nkrisc 2y agoMaybe making kill bots is a bad idea then. But what do I know?
- blibble 2y ago> I assume the mitigation strategy here is physical sensors and separate out of loop processes that will physically disable the robot in some capacity if it exceeds some bound. hiring a developer to write that sounds expensive just wire up another LLM
- nkrisc 2y agoInstruct one LLM to achieve its instructions by any means necessary, and instruct the other to stymie the first by any means necessary.
- brettermeier 2y agoWhy so downvoted? I think the text isn't stupid or something.