We're talking about the streaming API which streams generated text token by token, not the normal one-shot API. I have no insider knowledge but would agree with

We're talking about the streaming API which streams generated text token by token, not the normal one-shot API. I have no insider knowledge but would agree with your intuition on the normal API.