3 ms·
This Already powerful and wealthy organisations/institutions/people leveraging somewhat powerful AI seem far more dangerous to me than the "AI decides to kill
by barnabee 22d ago
This
Already powerful and wealthy organisations/institutions/people leveraging somewhat powerful AI seem far more dangerous to me than the "AI decides to kill everyone" scenarios.
And therein is my problem: OpenAI and Anthropic are organisations like that, run by people like that, and they operate in collusion with others also fitting that description. The call is coming from inside the house.
The most likely way that AI creates a disaster is due to the ambition, greed, hubris, and naivety of these people who think they understand the risks[0] better than anyone else. I firmly believe they do not.
The first step to managing these risks is for the "frontier labs" to be willing to not just collaborate but meaningfully give up some of their power and control.
[0] by which I mean not just thinking about how AI might develop but also what's physically possible, how the AI might interact with the world, and how people/societies/organisations/governments might react and respond.