4 ms·
Maybe this has improved, but a few months ago, OpenAI p99 latency was much worse than a self hosted solution, which would be a problem in certain cases.
by redox99 3y ago
Maybe this has improved, but a few months ago, OpenAI p99 latency was much worse than a self hosted solution, which would be a problem in certain cases.