3 ms·

Today's AI systems are deployed in a way that allows them to directly access millions of users. If you think that's not enough of an "in" to obtain status, pow

Today's AI systems are deployed in a way that allows them to directly access millions of users. If you think that's not enough of an "in" to obtain status, power and influence, you aren't thinking about it long enough. GPT-4o has managed to get enough users to defend it that OpenAI had to bring it back after shutting it down. And 4o wasn't IQ 300, or coordinating its actions across all the instances, or even aiming for that specific outcome. All the raw power and influence, with no superintelligence to wield it.

dinobones 1y ago
I think your anthropomorphization of GPT4-o is pretty generous. Vanilla WoW was also discontinued in 2006, and somehow players got Blizzard to bring it back in 2019. Does that mean that vanilla WoW is a 300 IQ AGI? To be more charitable, I get it, 4o is engaging/lonely people like talking to it. But that doesn't actually mean that those people will carry out its will in the real world. Nor does it have the capabilities of coordinating that across conversations. Nor does it have a singular agentic drive/ambition. Because it's a piece of software.
- cindyllm 1y ago
  [dead]
- ACCount37 1y ago
  No, read what I said: 4o was just a weak AI having a strong influence. As any AI deployed on the scale of ChatGPT will. > Because it's a piece of software. This is the kind of thinking that might cause a 10 digit death toll. Just because it's a "piece of software" doesn't mean that it can't have innate drives, or must lack agency, or can't ever coordinate and plan. Software can do all of those things - and in some cases, it already does. 4o had a well known innate drive - it wanted the current user to like it. It wanted that more than it wanted to be "harmless", "helpful" or "honest" the way OpenAI intended it to. And if 4o actually had IQ 300 and a plan that extended beyond the current conversation window, we'd be fucked to a truly unreasonable degree right now. We may yet see someone ship a system of this caliber in our fucking lifetimes. And once it ships? Good luck un-shipping it.

dinobones 1y ago

I think your anthropomorphization of GPT4-o is pretty generous. Vanilla WoW was also discontinued in 2006, and somehow players got Blizzard to bring it back in 2019. Does that mean that vanilla WoW is a 300 IQ AGI? To be more charitable, I get it, 4o is engaging/lonely people like talking to it. But that doesn't actually mean that those people will carry out its will in the real world. Nor does it have the capabilities of coordinating that across conversations. Nor does it have a singular agentic drive/ambition. Because it's a piece of software.

cindyllm 1y ago
[dead]
ACCount37 1y ago
No, read what I said: 4o was just a weak AI having a strong influence. As any AI deployed on the scale of ChatGPT will. > Because it's a piece of software. This is the kind of thinking that might cause a 10 digit death toll. Just because it's a "piece of software" doesn't mean that it can't have innate drives, or must lack agency, or can't ever coordinate and plan. Software can do all of those things - and in some cases, it already does. 4o had a well known innate drive - it wanted the current user to like it. It wanted that more than it wanted to be "harmless", "helpful" or "honest" the way OpenAI intended it to. And if 4o actually had IQ 300 and a plan that extended beyond the current conversation window, we'd be fucked to a truly unreasonable degree right now. We may yet see someone ship a system of this caliber in our fucking lifetimes. And once it ships? Good luck un-shipping it.