5 ms·
> - Summarisation and content distillation, question answering Etc: literally everywhere. This is now a solved problem (to the point of it being dull) thanks to
by dns_snek 3y ago
> - Summarisation and content distillation, question answering Etc: literally everywhere. This is now a solved problem (to the point of it being dull) thanks to LLMs.
Calling this problem domain "solved" only undermines whatever point you're trying to make, unless you really believe that current LLMs which fabricate information, flip flop between answers with follow up questions, and even gaslight the user, can be called "solutions".
LLMs have proven themselves to be such untrustworthy "sources" of information and knowledge that I'm struggling to understand why anyone would even try to make this particular claim. It's trivial to refute by anyone who's used them and has been thoroughly refuted by StackOverflow Developer survey which reported that only 2.8% of developers "highly trust" the output of AI tools.
https://survey.stackoverflow.co/2023/#section-developer-tools-accuracy-of-ai-tools https://survey.stackoverflow.co/2023/#section-developer-tool...
- famouswaffles 3y agoSummarization, language translation and tasks in that manner (morphing tasks?) get much lower hallucinations. Not sure what that survey has to do with anything.
- krainboltgreene 3y ago> Summarization, language translation and tasks in that manner (morphing tasks?) get much lower hallucinations. Source?
- famouswaffles 3y agoThere are no benchmarks that test that. It's my experience and the experience of others who use LLMs for such tasks. Down below there's a comment pushing back on saying Summarization has been solved. Even he/she is saying hallucination is rare.