3 ms·
What about streaming output — is there a uniform interface for all models for streaming output?
by d4rkp4ttern 3y ago
What about streaming output — is there a uniform interface for all models for streaming output?
- detente18 3y agoHi @d4rkp4ttern - yes it's standardized to the openai format - https://litellm.readthedocs.io/en/latest/stream/ https://litellm.readthedocs.io/en/latest/stream/