3 ms·
LLM's can self-reflect if you simply tell them to self-reflect. Typically they are trained to be frugal and shoot out quick responses without self reflecting. E
by xcv123 2y ago
LLM's can self-reflect if you simply tell them to self-reflect. Typically they are trained to be frugal and shoot out quick responses without self reflecting. Each generated token costs money. Just tell them to think about their response. That is chain of thought prompting.
"Which episode of Gilligan’s Island was about mind reading?
After writing your response, tell me how certain you are of its accuracy on a scale of 1 to 10. Then self reflect on your response and provide a more accurate response if needed."
- astrange 2y agoSelf-reflection and chain-of-thought are different things; CoT is about writing out the intermediate steps to an answer it can't immediately reach. Self-reflection doesn't work well though: https://arxiv.org/abs/2310.01798 https://arxiv.org/abs/2310.01798
- xcv123 2y agoThe paper you linked to mentions "self correction", which seems to be something else. Chain of thought is a form of self reflection. It enables the LLM to "think" through each step and evaluate each step in relation to the entire context window. That is evaluation of each thought in relation to its previous thoughts. Thinking about its thoughts.