2 ms·
> What makes them different to a very advanced Markov chain? Really nothing. There's some feedback structure in the layers of the model, it's not just one big
by ajross 3y ago
> What makes them different to a very advanced Markov chain?
Really nothing. There's some feedback structure in the layers of the model, it's not just one big probability table. But the technique is fundamentally the same, it's Markov, just with the whole conversation as input and with billions of parameters.