What is the point of these "exploits"? What interesting is in making language model (e.g. Markov chain on steroids) to produce arbitrary text? What is proved by

What is the point of these "exploits"? What interesting is in making language model (e.g. Markov chain on steroids) to produce arbitrary text? What is proved by it? I am genuinely interested.