3 ms·
At no point have I argued that LLMs aren’t autoregressive, I am merely talking about LLMs ability to reason across time steps, so it seems we are talking past e
by sailingparrot 1y ago
At no point have I argued that LLMs aren’t autoregressive, I am merely talking about LLMs ability to reason across time steps, so it seems we are talking past each other which won’t lead anywhere.
And yes, LLM can be studied under the lens of Markov processes: https://arxiv.org/pdf/2410.02724 https://arxiv.org/pdf/2410.02724
Have a good day