3 ms·
> the failure of these statistical language models to have a grounding in facts I feel the "grounding in facts" was a big mistake, and to a large extent still
by TeMPOraL 3y ago
> the failure of these statistical language models to have a grounding in facts
I feel the "grounding in facts" was a big mistake, and to a large extent still is. The worst case of it was symbolic linguistic and knowledge graphs. Why? Because symbols don't exist, facts and concepts and words are fuzzy boundaries, their meaning defined mostly or entirely through associations with other words. We don't learn symbolically, we don't have strong "grounding in facts" - not at the language layer.
I'd rather say that language and understanding, the way we do it, is statistical in nature, and "grounding in facts" is done through feedback.
- RandomLensman 3y agoGrounding in facts is the one thing where machines could actually improve upon humans (in the same way a calculator doesn't fail on every 10th calculation).
- Lord-Jobo 3y agoIn the context of LLMs it's only ever going to work out that wath math/stats, because garbage in garbage out will taint LLM output roughly to the same degree as human generation. Because humans are the garbage producers in both scenarios. To bypass the garbage in problem, you'll need a different AI structure from LLMs almost certainly, a proper logic model.
- anonymouskimmer 3y agoIs it the fundamental architecture of an LLM that makes this problematic, or the input? Based on how it's reported that they work, I assume that even without garbage in their statistical reasoning of the next word would occasionally come up with bad output. E.g. they might come up with 2 + 2 = 5 because of mathematical inputs such as "1 + 2 + 2 = 5".
- TeMPOraL 3y agoExcept it's unlikely because they have a bit larger context and are modeling a bit more than one-dimensional probabilities of "what comes after this?". I'd say that LLMs are more resistant to GIGO, as long as the fraction of garbage in training data is small - it'll look like outliers to the larger model.