3 ms·
IMO this is nonsense. How about the following preventions: 1 - make sure MI has no actors (by this logic LLMs are safe) 2 - make sure MI doesn't get control
by dmichulke 3y ago
IMO this is nonsense.
How about the following preventions:
1 - make sure MI has no actors (by this logic LLMs are safe)
2 - make sure MI doesn't get control over it's energy supply (so we can always starve it)
Easy, easy to verify, and we can in the meantime do something useful instead of the equivalent of discussing the potential risks of cars while living in the stone age.
Update to the replies:
1. "No actors" means it's like a person in prison - has the smartest person ever been able to socially engineer its way out of prison? No, it might have escaped with the help of social engineering but still actors were needed.
2. There's a plug for every machine we use. There is simply no way without actors to "work around" that.
Once we have generally capable robots that can fix stuff / solder things / push buttons AND those robots are controlled by an AI then we can start discussing.
However, this is not now, nor is it in the next 5 years.
- hurryer 3y agoChimps be like: don't fear the humans, we're more powerful than them and we'll control the banana supply.
- dmichulke 3y agoCompletely coincidental comparison for people that you disagree with, I suppose?
- xanderlewis 3y agoI think the counterargument is usually something like: since this is superhuman intelligence we are talking about, it by definition is (at least possibly) capable of thinking its way out of any given constraints. Simply not allowing it direct control over x does not prevent it from devising a clever plan to manipulate things in order to gain control of x, even including social engineering if necessary. The idea is that once something we’ve built is truly as ‘intelligent’ as we are, it becomes very hard to predict what it will be able to do (particularly because it operates on timescales unimaginable to us). So the verification you speak of is anything but easy.
- quickthrower2 3y ago“Make sure”? OpenAI can barely take care of it’s humans. What about a more intelligent system which is already on the internet which is in turn connect to most things (and anything airgapped is a trainable, trick-able human away)
- Vecr 3y agoGood luck to that when people have already hooked up LLM systems in chain of thought mode to Twitter accounts. Just substitute in the new AI model and it'll be an agent pretty quick I'd say.