Same here. If you believe the following research (which I do), the ability to perform complex reasoning is likely to be from training on code: https://yaofu.no

Same here. If you believe the following research (which I do), the ability to perform complex reasoning is likely to be from training on code: https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1 https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr... I think it's essential to increase the quantity of code tokens.