4 ms·
What LLM will we check those against? How do we trust that its source materials are accurate and correct?
by ysavir 2y ago
What LLM will we check those against? How do we trust that its source materials are accurate and correct?
- shiomiru 2y agoI think the idea is that you feed the LLM the article & the source material (from citations) and it checks if they match up.
- ysavir 2y agoSure, but what happens when the article is updated at a later date, or rescinded, etc.? Should the LLMs be trained to repeat the article verbatim, or to say "according to this article[0], blah blah blah" with links to the sources? Wikipedia works because we can update it in real time in response to changes. LLMs that need to constantly recrawl every time a page on the internet is updated, and that properly contextualize the content of that page, is a huge ask. Because at that point, it stops being an LLM and starts being a very energy-hungry search engine.
- shiomiru 2y agoWell, it's just a bot, so no need for it to instantly react to any and every update. I also have my doubts on whether it is possible to implement efficiently (or at all). I suspect that just yanking in the article and all the sources is non-feasible, and any smaller chunking would be missing too much context. Plus LLM logical capabilities are questionable too, so I don't know how well the comparison would work...