3 ms·
Will the stateful API make things faster or cheaper? Or does it just simplify the API usage? I'd guess mostly the latter, but don't know.
by anotheryou 3y ago
Will the stateful API make things faster or cheaper? Or does it just simplify the API usage? I'd guess mostly the latter, but don't know.
- usrbinbash 3y agoIt would simplify the API usage. An LLM model is stateless, and so still needs the complete context presented with every subsequent query.