3 ms·
Decoupling internal rumination from the final human friendly summary is the essence of "reasoning" models. It's not that I don't want the model to emit more to
by ithkuil 2y ago
Decoupling internal rumination from the final human friendly summary is the essence of "reasoning" models.
It's not that I don't want the model to emit more tokens. I just don't need to read them all.
Hence a formal split between thinking phase and communication phase provides the best of both worlds (at the expense of latency(