3 ms·
The main advantage of using a new and constant token for reasoning is that, while we would pay the full price during training, in the inference phase, we could
by fesens 2y ago
The main advantage of using a new and constant token for reasoning is that, while we would pay the full price during training, in the inference phase, we could do most, if not all, the "reasoning" in one shot, without having to feed one generation token at a time.
- jacobsimon 2y agoCool!