If it can predict the next sentence reliably, that sentence then becomes part of the context, so if you just continue inference, it would eventually produce the

If it can predict the next sentence reliably, that sentence then becomes part of the context, so if you just continue inference, it would eventually produce the entire text verbatim, no?