4 ms·
I love how many people add variations of "And be Correct" or "If you make a mistake correct yourself" as if that does anything. It is as likely to make a mistak
by drdrek 2y ago
I love how many people add variations of "And be Correct" or "If you make a mistake correct yourself" as if that does anything. It is as likely to make a mistake the first time as it is the second time. People imagine that it will work like when they do it externally, but that not how it works at all.
When you tell it to try again after it makes a mistake you add knowledge to the current system and raise the chance of success, like asking him to try again after getting it right will raise the chance for a failed response.
- Havoc 2y ago>"If you make a mistake correct yourself" as if that does anything. That part actually does work & makes sense. LLMs can't (yet) detect live mistakes as they make them, but they can review their past responses. That's also why there is experimentation with not showing users the output straight away & instead let it work on a scratch pad of sorts first
- drdrek 2y agohttps://bdtechtalks.com/2023/10/09/llm-self-correction-reasoning-failures/ https://bdtechtalks.com/2023/10/09/llm-self-correction-reaso...