2 ms·
Can you not simply reattempt? Then 10% failure appears more like volatility in the latency 10% of the time. Of course 1% of the time you have to reattempt twic
by fnordpiglet 3y ago
Can you not simply reattempt? Then 10% failure appears more like volatility in the latency 10% of the time. Of course 1% of the time you have to reattempt twice, .1 three times etc.
- bearjaws 3y agoA failure isn't just a 503, it's that instead of producing one of your function calls you specify using OAI functions, it instead produces a chat message. In some contexts it may make sense to have calls that can result in a function call, or just a chat message. One approach I am trying is to reduce the number of arguments, another is to reduce the number of function calls available. Either way, all of this introduces complication to building with OpenAI.
- fnordpiglet 3y agoAh I see - you don’t know a priori whether a text response is appropriate or a function call. Maybe I’m just being cheeky but what if you had an echo() function and asked that it always put chat responses through the echo function. That way if it breaks protocol you know?