3 ms·
An LLM is no more a fancy Markov Chain than you are. The math is well documented, go have a read.
by svachalek 2y ago
An LLM is no more a fancy Markov Chain than you are. The math is well documented, go have a read.
- jampekka 2y agoAbout everything can be modelled with large enough Markov Chain, but I'd say stateless autoregressive models like LLMs are a lot easier analyzed as Markov Chains than recurrent systems with very complex internal states like humans.