3 ms·
A markov chain maps states to states. You move from word "I" to word "will" or "can" or "want" The transition probabilities could be stored in a huge table. Yo
by nuclearnice3 4y ago
A markov chain maps states to states.
You move from word "I" to word "will" or "can" or "want"
The transition probabilities could be stored in a huge table.
You have a word and the probability of each other word. Draw a number and hop. [1,2]
Alternatively you could ask a neural net for the next state. Pass it the current token or the last 4000 token.
[1] https://towardsdatascience.com/text-generation-with-markov-chains-an-introduction-to-using-markovify-742e6680dc33 https://towardsdatascience.com/text-generation-with-markov-c...
[2] https://crowintelligence.org/2021/05/27/a-simple-markov-chain-text-generator-in-python/ https://crowintelligence.org/2021/05/27/a-simple-markov-chai...