4 ms·
Hey @breckenedge yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookb
by detente18 3y ago
Hey @breckenedge yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookbook/liteLLM_function_calling.ipynb https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
- d4rkp4ttern 3y agoWhat about streaming output — is there a uniform interface for all models for streaming output?
- detente18 3y agoHi @d4rkp4ttern - yes it's standardized to the openai format - https://litellm.readthedocs.io/en/latest/stream/ https://litellm.readthedocs.io/en/latest/stream/