4 ms·
> why do you find "next token predictor" to be the most useful mental model? To me it is an accurate description of the algorithm. And a sufficient explanation
by chrisjj 1mo ago
> why do you find "next token predictor" to be the most useful mental model?
To me it is an accurate description of the algorithm. And a sufficient explanation for the behaviour. So I don't need it or anything else as a mental model.
I accept this does not suffice for people who cannot comprehend the huge amount of processing and data the empowers it. Lacking a factual understanding, they reach for any mental model as a kind of superstition.
It is sufficiently advanced technology which to many is indistinguishable from magic. This disguises its limitations and enables its limitless false promotion to the gullible, being the reason it is so dangerous to individuals and society.
- HarHarVeryFunny 1mo agoI agree with this, but I just think that with two types of training LLMs are now a two-trick pony rather than a one-trick one.