4 ms·
I would be really helpful if there was some kind of confidence factor that the algorithm could express about its own result. Is this likely to be correct or is
by sharperguy 4y ago
I would be really helpful if there was some kind of confidence factor that the algorithm could express about its own result. Is this likely to be correct or is this just a best guess?
Currently it looks like it is only capable of writing text that states everything as a matter of pure fact, probably because most training data is written by authors who have already checked that their statements are correct (or at least believe them to be).
- antondd 4y agoHow would you know that the confidence factors the model gives you are correct or a best guess? Is it event possible with the current LLMs (see the Liar Paradox)? A better strategy is to use chain of thought prompting or similar techniques, essentially asking the model to explain how it arrived at a solution. https://github.com/openai/openai-cookbook/blob/main/techniques_to_improve_reliability.md https://github.com/openai/openai-cookbook/blob/main/techniqu...