5 ms·
> Using "chain of thought prompting" to get GPT-3 to "reason" based on those results IIRC gpt-3 can not do chain-of-thought
by est 4y ago
> Using "chain of thought prompting" to get GPT-3 to "reason" based on those results
IIRC gpt-3 can not do chain-of-thought
- stevenhuang 4y agoTrue but I believe when they said GPT-3 they meant Chatgpt, which has been RLHF trained and does show chain of thought reasoning capabilities.
- abetlen 4y agoThis is not true, GPT-3 can perform chain-of-thought reasoning through in-context learning either by one/few-shot examples or zero-shot by starting a prompt with "let's think step by step" (less reliable). GPT-3.5 (what's being used here) is a little better at zero-shot in-context learning as it's been intstruction fine-tuned so it's only given the general format in the context.
- ma2rten 4y agoThis is not correct, I am a co-author of the chain of thought paper and we reported GPT-3 results.
- est 4y agoI got the impression from this https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tracing-Emergent-Abilities-of-Language-Models-to-their-Sources-b9a57ac0fcf74f30a1ab9e3e36fa1dc1 https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr... > The initial GPT-3 is not trained on code, and it cannot do chain-of-thought Does this mean some extra steps are required to make gpt-3 perform CoT?
- sebzim4500 4y agoIf you have examples of CoT in the prompt than GPT-3 will give it a go. It won't be nearly as good as the finetuned models though.