5 ms·
It seems that tool calling shouldn't be 500ms of latency?
by angry_octet 6mo ago
It seems that tool calling shouldn't be 500ms of latency?
- hobofan 6mo agoIf you have tool calling complex enough that it necessitates a higher reasoning level, and you would otherwise have reasoning set to "none", this can easily come out to 500ms.