4 ms·
An LLM that only used “factual encyclopedia data” as its training set would probably be very good at producing content that looked like encyclopedia articles, b
by dragonwriter 3y ago
An LLM that only used “factual encyclopedia data” as its training set would probably be very good at producing content that looked like encyclopedia articles, but bad at anything else.
Probably wouldn’t be any less prone to confabulation than any other LLM, and given how limited in coverage the sum of any factual encyclopedia is compared to typical LLM training sets, would have even a spottier base of factual information that most LLM’s have to work from.
> If they can completely eliminate hallucinations
Yes, but that’s orthogonal to the training set.
- justinclift 3y ago> Yes, but that’s orthogonal to the training set. Of course. I didn't say otherwise. > An LLM that ... Note that I also wrote "AI" rather than "LLM". ;) Hopefully there will be better alternatives (to LLMs) at some point that don't hallucinate. My point is that having one of those (something that doesn't hallucinate) trained on factual data sounds like it'd be useful. :)
- dragonwriter 3y ago> Hopefully there will be better alternatives (to LLMs) at some point that don’t hallucinate. There are AIs that don’t “hallucinate” (a bad metaphor), e.g., most of the technologies developed in the previous rounds of AI – like expert systems. I doubt that we will find more advanced, equally-or-more general AI techniques than LLMs that don’t “hallucinate”, what we’ll probably do is find better ways to build systems around LLMs (or more future AI architectures) that allow them to resolve “hallucination” better before presenting results. It’s not as if natural intelligences don’t both literally hallucinate and, more relevant to what is described as “hallucination” in AIs, confabulate when pressed to answer without access to facts, and we know with them that grounding in physical reality via sensory data and having access to factual references doesn’t mitigate those effects (and we’ve also been able to demonstrate the latter with LLMs.)
- nickpsecurity 3y agoYou’re missing that you can reinforce information by repeating specific, data sets. They could use some repetitions of it to drill in the knowledge, put in a lot of content that’s less reliable in a different style, and re-run high-quality content afterwards to reinforce it. The AI’s already accidentally do that for topics people repeat a lot on the Internet, esp political. ChatGPT used to fight with me over some of those. That it would not relent or stop redirecting me showed that they can be trained to follow authoritative sources, too.