3 ms·
I reject the premise that https://ai-2027.com/ https://ai-2027.com/ needs "refutation". It is a story, nothing more. It does not purport to tell the future, but
by andrewla 11mo ago
I reject the premise that https://ai-2027.com/ https://ai-2027.com/ needs "refutation". It is a story, nothing more. It does not purport to tell the future, but to enumerate a specific "plausible" future. The "refutation" in a sense will be easy -- none of its concrete predictions will come to pass. But that doesn't refute its value as a possible future or a cautionary tale.
That the story it tells is completely absurd is what makes it uninteresting and disqualifying for all participants in terms of their ability to comment on the future of AI.
Here is the prediction about "China Steals Agent-2".
> The changes come too late. CCP leadership recognizes the importance of Agent-2 and tells their spies and cyberforce to steal the weights. Early one morning, an Agent-1 traffic monitoring agent detects an anomalous transfer. It alerts company leaders, who tell the White House. The signs of a nation-state-level operation are unmistakable, and the theft heightens the sense of an ongoing arms race.
Ah, so CCP leadership tells their spies and cyberforce to steal the weights so they do. Makes sense. Totally reasonable thing to predict. This is predicting the actions of hypothetical people doing hypothetical things with hypothetical capabilities to engage in the theft of hypothetical weights.
Even the description of Agent-2 is stupid. Trying to make concrete predictions about what Agent-1 (an agent trained to make better agents) will do to produce Agent-2 is just absurd. Like Yudkowsky (who is far from clear-headed on this topic but at least has not made a complete fool of himself) has often pointed out, if we could predict what a recursively self-improving system could do then why do we need the system.
All of these chains of events are incredibly fragile and they all build on each other as linear consequences, which is just a naive and foolish way to look at how events occur in the real world -- things are overdetermined, things are multi-causal; narratives are ways for us to help understand things but they aren't reality.
- reducesuffering 11mo agoSure, in the space of 100 ways for the next few years in AI to unfold, it is their opinion of one of the 100 most likely, to paint a picture for the general population about what approximately is unfolding. The future will not go exactly as that. But their predictive power is better than almost anyone else. Scott has been talking about these things for a decade, before everyone on this forum thought of OpenAI as a complete joke. It's in the same vein as Daniel Kokotajlo's 2021 (pre ChatGPT) predictions that were largely correct: https://www.alignmentforum.org/posts/6Xgy6CAf2jqHhynHL/what-2026-looks-like https://www.alignmentforum.org/posts/6Xgy6CAf2jqHhynHL/what-... Do you have any precedent from yourself or anyone else about correctly predicting the present from 2021? If not, maybe Scott and Daniel just might have a better world model than you or your preferred sources.