2 ms·
It is an unfortunately anthropomorphizing term for a transformer simply operating as designed, but the thing it's become a vernacular shorthand for, "outputting
by mortenjorck 2y ago
It is an unfortunately anthropomorphizing term for a transformer simply operating as designed, but the thing it's become a vernacular shorthand for, "outputting a sequence of tokens representing a claim that can be uncontroversially disproven," is still a useful concept.
There's definitely room for a better label, though. "Empirical mismatch" doesn't quite have the same ring as "hallucination," but it's probably a more accurate place to start from.
- NovemberWhiskey 2y ago>"outputting a sequence of tokens representing a claim that can be uncontroversially disproven," is still a useful concept. Sure, but that would require semantic mechanisms rather than statistical ones.
- riwsky 2y agoStatistics has a semantics all its own
- hbn 2y agoRegardless I don't think there's much to write papers on, other than maybe an anthropological look at how it's affected people putting too much trust into LLMs for research, decision-making, etc. If someone wants info to make their model to be more reliable for a specific domain, it's in the existing papers on model training.
- deleted 2y ago[deleted]