3 ms·

I got the impression from this https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac

by est 4y ago

I got the impression from this https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1 https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr... > The initial GPT-3 is not trained on code, and it cannot do chain-of-thought Does this mean some extra steps are required to make gpt-3 perform CoT?

sebzim4500 4y ago
If you have examples of CoT in the prompt than GPT-3 will give it a go. It won't be nearly as good as the finetuned models though.