Total guesswork on my part, but at the simplest level it could be something like they'll let you store context on their system (for example, in a long system pr

Total guesswork on my part, but at the simplest level it could be something like they'll let you store context on their system (for example, in a long system prompt) and let you pull that in more easily than sending it over the wire on every request. At a more complex level, it could be something like having their own RAG for knowledge you upload and to automatically use it to supplement your future requests, but that feels far less likely to me.