3 ms·
Interesting to note how similar this seems to what happened with Benj Edwards at Ars Technica. AI was used to extract or summarize information, and quotes found
by tobr 7mo ago
Interesting to note how similar this seems to what happened with Benj Edwards at Ars Technica. AI was used to extract or summarize information, and quotes found in the summary were then used as source material for the final writing and never double checked against the actual source.
I’ve run into a similar problem myself - working with a big transcript, I asked an AI to pull out passages that related to a certain topic, and only because of oddities in the timestamps extracted did I realize that most of the quotes did not exist in the source at all.
- raw_anon_1111 7mo agoThis seems like a solved problem. Any RAG interface I design I have links to the original source and passage. Even NotebookLM does this.
- mh- 7mo agoFor the curious, the term of art is Grounding. e.g.: https://docs.cloud.google.com/vertex-ai/generative-ai/docs/grounding/overview https://docs.cloud.google.com/vertex-ai/generative-ai/docs/g...
- Planktonne 7mo agoIt was already a solved problem with cmd/ctrl + f.
- tobr 7mo agoIt might be a solved problem in the sense that it has a possible solution, but not in the sense that it doesn’t happen with the tools most people would expect to be able to handle the task.