3 ms·
To a first approximation, yes. The second approximation has significant differences, but that's an ok first pass at it.
by jfengel 4y ago
To a first approximation, yes.
The second approximation has significant differences, but that's an ok first pass at it.
- skybrian 4y agoAs a mathematical model, it's almost completely unhelpful, like saying that all computers are technically state machines because they have a finite amount of memory. Treating every combination of 4k tokens as a separate state with independent probabilities is useless for making probability estimates. Better to say that it's a stateless function that computes probabilities for the next token and leave Markov out of it.