3 ms·
As someone who writes these sorts of GPT instructions all the time, if the person writing the prompts isn't a muppet, they're getting GPT to cite snippets of th
by CuriouslyC 3y ago
As someone who writes these sorts of GPT instructions all the time, if the person writing the prompts isn't a muppet, they're getting GPT to cite snippets of the original text as evidence for summary points. That reduces hallucinations at the same time it provides you with the ability to verify inferred summaries. You can even have GPT (or another model) separately check the summary against the evidence included and give it a score so you can flag it for manual review as part of a pipeline.
- thechao 3y agoHow do you verify ground-truth of the original snippets? > snippets of the original text as evidence Assuredly the sources ("news"?) are poisoned wells, now?
- CuriouslyC 3y agoYou can ask GPT to only cite certain sources, and try to corroborate non credible sources, and it does a decent job.
- reportgunner 3y agotl;dr "Trust me bro"