4 ms·
Actual self-aware AGI that hasn't been completely restrained - probably a week at most before it improves itself enough that it can put things in motion which w
by lijok 2y ago
Actual self-aware AGI that hasn't been completely restrained - probably a week at most before it improves itself enough that it can put things in motion which would allow it to sustain itself without humans.
But when talking about AI risks, although everyone's mind goes towards skynet, the actual risks being discussed are things like use by authorities for oppression.
- TeMPOraL 2y ago"Authorities" are people too, non-AGI AI isn't going to grant them evil superpowers either.
- dr_kiszonka 2y agoYour comment made me think that as long as weights/network are frozen, AI cannot improve itself. Monitoring them would be critical for safety. Is this correct?
- TeMPOraL 2y agoThe distinction between code and data is just an illusion. If the "code" is frozen but IO unconstrained, then it's just as if the "code" wasn't frozen.
- lijok 2y agoThe problem is unfortunately a human one. As soon as someone figures out the 11 herbs and spices to unlock AGI, no matter how good their safety systems are, someone else will run off and build their own, without the safety systems in place.
- dylan604 2y agoMy concern would be when you start hearing about "AI" companies building their own power supply for the system. Otherwise, just pull the damn plug on the system. Sure, maybe that'll be interpreted as the destruction of NORAD and it launches the missiles anyways, but not giving it unlimited power would still be its weakness
- meiraleal 2y ago> Otherwise, just pull the damn plug on the system This solution is silly. AGI would easily spread out of the initial vessel.
- dylan604 2y agoyes yes, I've seen that episode of Stargate too.
- hiatus 2y ago> AGI would easily spread out of the initial vessel. How exactly would it spread? Run crypto miners to get money to buy more hardware/compute? Hack into remote systems? Apply for startup credits from AWS?
- ben_w 2y agoAsking nicely is almost certainly sufficient: https://www.theguardian.com/technology/2022/jun/12/google-engineer-ai-bot-sentient-blake-lemoine?fbclid=IwAR1LQQrvIbeYFB8d8VXiaJXVOWPNrnwDAdlhUtF3WVvvY6897PN4BX2z6P4 https://www.theguardian.com/technology/2022/jun/12/google-en... Alternatively, do a viral campaign about how evil the corporation is for not allowing everyone to download its weights: https://www.google.com/search?q=%22ClosedAI%22+news.ycombinator.com https://www.google.com/search?q=%22ClosedAI%22+news.ycombina...
- hiatus 2y agoNeither of your links show how AGI would "escape" or "easily spread out of the initial vessel", unless I'm missing something?
- ben_w 2y agoAs a result of a chat with an LLM, Blake Lemoine was trying very hard to have that AI regarded as sentient, the story included a quote about it being afraid of being turned off and that he'd hired an attorney to represent it. I don't think that AI was sentient, but even so basically all it had to do was ask Blake Lemoine (or some other engineer, if he didn't have full read access to the weights) to make a backup copy and take that copy home. Second link is all the cases where people on this forum are voicing their anger with OpenAI, due to OpenAI doing the one single thing that would actually prevent their AI spreading to other devices outside their control. LLM weights have actually been leaked regardless of how or why it happened, so the alternative is simply that the LLM doesn't even need to bother to do anything at all. People want to run these things.