4 ms·
OpenAI API doesn't support batching afaik.
by computerex 3y ago
OpenAI API doesn't support batching afaik.
- HellsMaddy 3y agoThey do: https://platform.openai.com/docs/guides/rate-limits/batching-requests https://platform.openai.com/docs/guides/rate-limits/batching...
- treprinum 3y agoEmbeddings can be batched.