4 ms·
Let me ground this a bit: at the core, LLMs are systems trained to predict the next token in a sequence. They can learn extremely rich statistical structure fro
by bborud 5mo ago
Let me ground this a bit: at the core, LLMs are systems trained to predict the next token in a sequence. They can learn extremely rich statistical structure from language and become surprisingly capable, but extrapolating from that to something akin to a robust general intelligence is a much stronger claim.
The open question is not “can next-token prediction produce impressive behavior?” Clearly it can. The question is whether scaling that mechanism is enough to produce stable world models, grounded understanding, long-horizon agency, self-correction, and reliable reasoning across novel situations.
That has not been demonstrated.
In the past few years I've repeated the same thing: I'm not afraid of AIs that are hallucinating. They do that by design. It is expected. What scares me is people who hallucinate something into existence which isn't there.