6 ms·
FWIW, OpenAI's availability seems to have gotten significantly better since May when we launched with them. I monitor our availability Service Level Objective a
by phillipcarter 3y ago
FWIW, OpenAI's availability seems to have gotten significantly better since May when we launched with them. I monitor our availability Service Level Objective and we keep needing to increase the success rate because they keep improving things.
This doesn't take away from high availability being a legitimate need to host your own LLM, though.