GPT is great at text generation, but astonishingly poor at coherent text generation over a a window of more than a few sentences. To be fair, this is a massive

GPT is great at text generation, but astonishingly poor at coherent text generation over a a window of more than a few sentences. To be fair, this is a massive improvement from SOTA ten years ago, but it's definitely nowhere near AGI (and maybe not even a finger pointing at the moon).