3 ms·
They have the Markov property that the next state depends only on the current state (context window plus the weights of the model) do they not? Any stochastic p
by seanhunter 2y ago
They have the Markov property that the next state depends only on the current state (context window plus the weights of the model) do they not? Any stochastic process which possesses that property is a Markov process/chain I believe.
- fooker 2y agoThe universe has that property too. But no, most LLMs have a tweakable 'temperature' parameter that introduces some randomness and sometimes have very interesting results.
- seanhunter 2y agoTemperature just changes how an llm samples from the token distribution so I wouldn’t think that constitutes “memory” that would contradict the Markov property