4 ms·
It was already known that training on code improves performance on all reasoning tasks[1], so this is not really surprising. [1] https://arxiv.org/abs/2210.071
by wcoenen 3y ago
It was already known that training on code improves performance on all reasoning tasks[1], so this is not really surprising.
[1] https://arxiv.org/abs/2210.07128 https://arxiv.org/abs/2210.07128
- deleted 3y ago[deleted]
- habitue 3y agoI don't think it can be dismissed that easily. You could imagine that most of the benefit from being trained on programming languages comes from learning any language at all, but a 15% gain from one language to another is pretty surprising I'd say.