4 ms·
Maybe a charitable reading of the parent comment, but my interpretation of it was that while the _models_ are stateless, modern deployments of these models for
by zsyllepsis 4mo ago
Maybe a charitable reading of the parent comment, but my interpretation of it was that while the _models_ are stateless, modern deployments of these models for inference rely on state.
For example, tiered pricing for cached context relies on state, even if the models don’t.
- zahlman 4mo agoFor that matter, the agent harness accumulating "chat history" is state.