4 ms·
> tl;dr most of the LLMs people use are effectively Markov Chains. ...when they are used without RAG and tools. x_n belongs to a set of cardinality 65536^10000
by red75prime 1y ago
> tl;dr most of the LLMs people use are effectively Markov Chains.
...when they are used without RAG and tools. x_n belongs to a set of cardinality 65536^100000 or so. Equating an LLM to a Markov Chain doesn't allow to make any non-trivial predictions about its behavior.