3 ms·
The grounding is really strange. This example includes a Reddit post as a source: https://kite.kagi.com/s/hjgy55 https://kite.kagi.com/s/hjgy55 But that post
by tantalor 1y ago
The grounding is really strange.
This example includes a Reddit post as a source:
https://kite.kagi.com/s/hjgy55 https://kite.kagi.com/s/hjgy55
But that post is actually a link to reuters.com
There is also a list of "citations" which are referenced from the generated text, and "sources" which are not referenced anywhere. It's not clear if they used reddit or reuters to generate any of the text.
I also see lots of citations to "common knowledge"... which is um, weird.
For example:
> National Guard activation: Guard forces can serve under state control (Title 32) or be federalized (Title 10), which determines who directs missions and the scope of authority [*].
Is this common knowledge?
- giorgio-kagi 1y agoHey - Reddit is included as a source because posts can contain firsthand accounts and independent analysis. The RSS feed we use from Reddit provides the post title and text. So to answer your question, when you see Reddit as a source we are using the aforementioned data, not what it links to. About "common knowledge" sources - we validate all content for accuracy. When the LLM needs to add context that's missing from sources (e.g. historical background), we mark these as "common knowledge" since this generated content can't be validated against the original sources. You're right that your example isn't common knowledge at all, we'll work on adding actual sources for these claims too. Thanks for trying it out!
- tantalor 1y agoIf the content can't be grounded then it should be dropped.