4 ms·
hallucinations decrease with scale and reasoning, the model just gets better and stops making stuff up.
by whimsicalism 2y ago
hallucinations decrease with scale and reasoning, the model just gets better and stops making stuff up.
- littlestymaar 2y agoo1 still hallucinates badly though.
- Jerrrry 2y agoFalse, facts only need to be seen once, and one mis-step in reasoning and your CoT is derailed.
- whimsicalism 2y ago> one mis-step in reasoning and your CoT is derailed. tell me you've never seen reasoning traces without telling me