> recursive application of the model itself That's how chat with LLMs works. The LLM is not stateful, with every response you need to submit the entirety of th

> recursive application of the model itself That's how chat with LLMs works. The LLM is not stateful, with every response you need to submit the entirety of the past conversation including its own past output. > a bit messy in that there would be some loss of information There has to be a loss of information either way. Their API calls for the web interface point very strongly toward enabling summarization once you exceed a given length. > Anyway, I got some clarification from ChatGPT itself As the other comment points out, what you got was a complete hallucination. "Context chunking" is not a thing, there's a context window and if you submit more than it can fit, the API returns an error response. If you almost fill the window, it returns what it can and but raises an error flag. There's a system prompt, but ChatGPT is using that to kick off the conversation, you can see in the API calls that even your first message is submitted a user message, and storing that system prompt is still external to the LLM