4 ms·
The instances of that happening are likely the LLM failing to call the engine for whatever reason and falling back to inference.
by shtack 2y ago
The instances of that happening are likely the LLM failing to call the engine for whatever reason and falling back to inference.