2 ms·
My assumption has been that emitting those tokens is part of the inference, analogous to humans "thinking out loud".
by zahlman 9mo ago
My assumption has been that emitting those tokens is part of the inference, analogous to humans "thinking out loud".
- abustamam 9mo agoYou're absolutely right!