5 ms·
How do you know if it is correct or a hallucination?
by deadmutex 3y ago
How do you know if it is correct or a hallucination?
- ronsor 3y agoPresumably one can test it with documents one has already read and knows before. If the summaries of the test documents are good, future summaries will probably be OK too.
- lambdaba 3y agoMaybe having it summarize a fiction book (outside of training data)?
- zmmmmm 3y ago> If the summaries of the test documents are good, future summaries will probably be OK too But that is exactly what is problematic with hallucinations. It's a rare / exceptional behaviour that triggers extreme departure from reality. So you can't estimate the extremes by extrapolating from common / moderate observations. You would have to test a lot of previous documents to be confident, and even then there would be a residual risk.
- sitkack 3y agoAs with anyone, if you are going to take action on something, double check it.
- luma 3y agoInvestigate, same as you would a paralegal etc. If it makes an assertion, contest it and ask where it found supporting evidence in the document for the claims made. Ask it to make the counter-argument, also with sources. Verify as needed.
- paxys 3y agoThat's what prompting is all about. Ask it to prove its statements. Ask it to quote passages that support its arguments. Then double and triple check it yourself. It isn't going to do the work for you, but can still be a pretty great reference tool.