> What LLMs are, at least in their current state, is not fundamentally different from a simple markov chain generator. The output can contain words that are on

> What LLMs are, at least in their current state, is not fundamentally different from a simple markov chain generator. The output can contain words that are only in the prompt and not the training set. (I asked the Bing chatbot about a "word" I got from /dev/urandom) I don't think a proper Markov chain can handle that sort of thing?