Even old Markov chains has a context window of a few words, single word context Markov chains produce horrible results. People who don't think LLMs are Markov

Even old Markov chains has a context window of a few words, single word context Markov chains produce horrible results. People who don't think LLMs are Markov chains are just ignorant, not realizing that Markov chain isn't an algorithm, you can compute the probability in any manner and it is still a Markov chain.