2 ms·
They're different because Markov models are stateless whereas LLMs are stateful. https://en.wikipedia.org/wiki/Markov_property https://en.wikipedia.org/wiki/Ma
by esafak 3y ago
They're different because Markov models are stateless whereas LLMs are stateful.
https://en.wikipedia.org/wiki/Markov_property https://en.wikipedia.org/wiki/Markov_property
- Jensson 3y agoCurrent LLMs are stateless as far as we know, their state when computing a new token is only the preceding text tokens, they don't store any metadata or save state from the previous calculations.