3 ms·

Absolutely not a troll. Hey, I hope you're right about it being too difficult to simulate humanity for an AGI to take over. That said, there are bad scenarios

Absolutely not a troll. Hey, I hope you're right about it being too difficult to simulate humanity for an AGI to take over. That said, there are bad scenarios where we just get so dependent on AI that we voluntarily cede control to it, little by little, and then things go wrong once it's too late. And you don't have to fully simulate reality to be really, really good at achieving your goals. We don't fully simulate every particle on a spacecraft, but we get them where they need to go, because we have simplifying models. And even a human level intelligence can be really dangerous if you give it enough time to think. There's a reason people play chess worse when they play a 30 second game vs a 2 hour time limit. As far as taking not actions, though? When I posted this, I was having a really rough day. But in a way, posting this was an action. Making people more aware that someone else is afraid of this, providing social proof that it's ok to be afraid of this and talk about it publicly. But I'm 100% trying to focus my energy productively here. Since I became aware of this issue, I've created a substack: https://strangerprotocols.substack.com/ https://strangerprotocols.substack.com/ and tiktok account: https://www.tiktok.com/@humanguard https://www.tiktok.com/@humanguard I'm going to spread this warning as far as I can with my limited resources. I'm not sure if I'm smart enough to contribute meaningfully to alignment research, but I'm trying to learn what I can and think on the problem. I think it's probably too late to stop the freight train from going off the cliff but I think it's also the rational thing to do.

ActorNightly 3y ago
>That said, there are bad scenarios where we just get so dependent on AI that we voluntarily cede control to it, little by little, and then things go wrong once it's too late. You have to get rid of the idea that an AI will start doing something that we don't explicitly tell it to. Sure, in the future it will be possible to accomplish same tasks with AI that would take multiple smart humans to do. There are still limits in place though. >And you don't have to fully simulate reality to be really, really good at achieving your goals. We don't fully simulate every particle on a spacecraft, but we get them where they need to go, because we have simplifying models Yes, because we have found patters in non chaotic systems. Not all systems are like that. Why can't we predict the stock market? Stephen Wolfram talks about this, its a phenomenon called computational irreducibility, meaning that some processes cannot be simply just estimated with a mathematical formula, and furthermore, these processes can arise from very simple rules. The point that Im trying to make is that your warnings are absolutely empty. Its equivalent to those people worried that LHC was going to punch a hole in our universe. There is zero information right now to base any worry of an advanced AI.

ActorNightly 3y ago

>That said, there are bad scenarios where we just get so dependent on AI that we voluntarily cede control to it, little by little, and then things go wrong once it's too late. You have to get rid of the idea that an AI will start doing something that we don't explicitly tell it to. Sure, in the future it will be possible to accomplish same tasks with AI that would take multiple smart humans to do. There are still limits in place though. >And you don't have to fully simulate reality to be really, really good at achieving your goals. We don't fully simulate every particle on a spacecraft, but we get them where they need to go, because we have simplifying models Yes, because we have found patters in non chaotic systems. Not all systems are like that. Why can't we predict the stock market? Stephen Wolfram talks about this, its a phenomenon called computational irreducibility, meaning that some processes cannot be simply just estimated with a mathematical formula, and furthermore, these processes can arise from very simple rules. The point that Im trying to make is that your warnings are absolutely empty. Its equivalent to those people worried that LHC was going to punch a hole in our universe. There is zero information right now to base any worry of an advanced AI.