Based on the previous words up to severeal tens of thousands of them. And that's the major difference with a system like a markov-chain where this would be impo

Based on the previous words up to severeal tens of thousands of them. And that's the major difference with a system like a markov-chain where this would be impossible to do efficiently at that scale.