3 ms·
It always hurt the effectiveness of the LLMs. Asking them to be concise and give answers without explanations has always been an easy way to degrade model perfo
by TeMPOraL 2y ago
It always hurt the effectiveness of the LLMs. Asking them to be concise and give answers without explanations has always been an easy way to degrade model performance.
- ithkuil 2y agoDecoupling internal rumination from the final human friendly summary is the essence of "reasoning" models. It's not that I don't want the model to emit more tokens. I just don't need to read them all. Hence a formal split between thinking phase and communication phase provides the best of both worlds (at the expense of latency(