3 ms·
Your question should be "Can it drill down to show the paragraphs or sentences that influence the answer?" I believe that the plagiarism complaint about llm mo
by rickydroll 8mo ago
Your question should be "Can it drill down to show the paragraphs or sentences that influence the answer?"
I believe that the plagiarism complaint about llm models comes from the assumption that there is a one-to-one relationship between training and answers. I think the real and delightfully messier situation is that there is a many-to-one relationship.
- great_psy 8mo agoThe example on the website shows one to many as well: Wikipedia, axive article, etc along with a ratio how much it influences the chunk of the answer.
- adebayoj 8mo agoExactly! We will have a future post that shows this more granularly over the coming weeks. Here is a post we wrote on how this works at smaller scale: https://www.guidelabs.ai/post/prism/ https://www.guidelabs.ai/post/prism/
- rickydroll 8mo agoOh, that looks like a wonderful article. I just skimmed it, and I hope to get back to it later today. One thing I would love to see is how much of the training set is substantially similar to each other, especially in the code training set.