3 ms·
"...Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT in
by belter 4y ago
"...Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT instruction ``Let's think step-by-step'' to each input query of MultiArith dataset, GPT-3's accuracy can be improved from 17.7\% to 78.7\%. However, it is not clear whether CoT is still effective on more recent instruction finetuned (IFT) LLMs such as ChatGPT. Surprisingly, on ChatGPT, CoT is no longer effective for certain tasks such as arithmetic reasoning while still keeping effective on other reasoning tasks. Moreover, on the former tasks, ChatGPT usually achieves the best performance and can generate CoT even without being instructed to do so...
...Hence, it is plausible that ChatGPT has already been trained on these tasks with CoT and thus memorized the instruction so it implicitly follows such an instruction when applied to the same queries, even without CoT. Our analysis reflects a potential risk of overfitting/bias toward instructions introduced in IFT, which becomes more common in training LLMs..."
- amrb 4y agoI found to very difficult to set goals with gpt-turbo, maybe gpt4 will be a good test when I get access. Also I'm thinking would be interesting to train a LoRa, using synthetic prompts.
- inawarminister 4y agoHave you tried Langchain? The Search agent using GPT-turbo is really good in my experience. Now to replicate it using local LLAMA...
- nerdponx 4y agoIt's really weird to me that we now have research papers dedicated to exploring the emergent behavior of systems that other people built, but where the researchers can only speculate about what the builders actually did to build the thing. "Open" AI indeed.
- rmbyrro 4y agoI think the "Open" in OpenAI is about open access, not open source. I'm really glad they are "democratic" in releasing their products. I'd hate if I had to go through a "Talk to our salespeople" form ik order to use them.
- monsieurbanana 4y agoWith that definition every single big software company is open. Microsoft the most open of all, they don't care if you pirate Windows as it brings them more market share.
- throwawayapples 4y agoThen they wouldn't be nearly as good. You're training GPT for them for free (or even paying them for the privilege.)
- colordrops 4y agoNo, that's not what they meant. Read the history of its founding. They changed their charter after it was founded.
- jacquesm 4y agoIt might also be post/pre processing.
- jychang 4y agoSounds like talking to a kid (or any human being, really) about a complicated math homework problem. Making a kid say their reasoning step by step would increase accuracy.