3 ms·
> An LLM can only look at each token and can't, statistically speaking, think in terms of the entire query. There's always some space in high-dimensions to put
by pas 2y ago
> An LLM can only look at each token and can't, statistically speaking, think in terms of the entire query.
There's always some space in high-dimensions to put that extra context somewhere. So yes, only one token is predicted, but there's a lot of information squeezed into the "condition" (as in conditional probability, as mjburgess' comment shows)
> [hype instead of NLP]
yes, exactly. we'll see what remains after the bubble bursts.