3 ms·
I don’t know of a consensus for it to be “considered” one way or another. I think explicitly asking for COT is temporary, and it will move to a layer that’s enc
by travisjungroth 4y ago
I don’t know of a consensus for it to be “considered” one way or another. I think explicitly asking for COT is temporary, and it will move to a layer that’s encapsulated from most users. It will persist there as long as long as the language layer is doing the “thinking”. If the language layer is completely offloading that and just translating, it won’t be needed.
I’ve been explaining it to people as “if ChatGPT can think, it can only think out loud”. Because of the way LLMs were trained, nudging it to do this will continue to be valuable.
Most writing about anything difficult is product, not process. Articles get drafts before being published. People think about answers before writing them down. How to Solve It does a great job explaining this about math problems. The steps to the proof are not the steps to creating the proof.
So when you go to solve a problem by mimicking the solutions to problems, something is missing. People will either need to train LLMs to do it, or continue to ask for it in prompts.