3 ms·
The click through API is mainly for prototyping. If you want better latency and sane billing you need to go through Azure OpenAI Services. OpenAI also offers
by throwaway9274 3y ago
The click through API is mainly for prototyping.
If you want better latency and sane billing you need to go through Azure OpenAI Services.
OpenAI also offers decreased latency under the Enterprise Agreement.