As encouraging as GPT-3 results are, I still don't see the critical ability to synthesize large scale structure (think book-level as opposed to just a few sente

As encouraging as GPT-3 results are, I still don't see the critical ability to synthesize large scale structure (think book-level as opposed to just a few sentences) manifest in this research. Even the much touted 0.7 temperature revenge of the sith examples don't exhibit coherent high level structure that continues across the span of more than a few sentences. And I differentiate high level structure from long distance structure. The algorithm does appear to be able to relate themes from a sentence earlier in a generated text to ones which appear later (up to a few paragraphs later). But the narrative connecting those sentences seems shallow and lacks depth. Compare this with the complex, multi tiered narrative that underpins the structure of a well written book or body of research. My intuition here is that there is an exponential relationship between the "depth" evident in the narrative of generated text and the number of parameters required in the model that places viable, AGI-like intelligence still much further in the future.