I agree with that. The Transformer architecture does not satisfy the Markov property by formal definition. ChatGPT is not a Markov chain. However the Turing m

I agree with that. The Transformer architecture does not satisfy the Markov property by formal definition. ChatGPT is not a Markov chain. However the Turing machine which is executing the algorithm does satisfy the Markov property. So you're talking about a lower level of abstraction where any computation of any algorithm is just "running on a Markov chain".