3 ms·
"test error" or "misprediction" aren't very applicable terms for RL, though. is it a "test error" if the LLM suggests a bad chess move? is it a "misprediction"
by sterlind 2y ago
"test error" or "misprediction" aren't very applicable terms for RL, though. is it a "test error" if the LLM suggests a bad chess move? is it a "misprediction" if the LLM can't find a mating sequence? are those "failures to forecast out-of-sample inputs," or only if the LLM suggests an illegal chess move or call an API that doesn't exist?
I say that a model "hallucinates" only if it specifically presents false information as fact - e.g. that Bolognium is element 115, or that chocolate milk comes from brown cows. giving irrelevant or undesired answers isn't hallucination or confabulation. but I don't think your terms are precise enough for that nuance.
- acc_297 2y agoI grant that the term has become commonplace and very catchy and no one has been able to supplant it with a better descriptive I still hold that there is good reason to be concerned with researchers claiming to objectively evaluate a silicon based sentience and jumping the gun a bit (imo) by writing articles about LLMs which "dream" and "hallucinate" when the behaviour is a consequence of essentially a non-linear regression model that does not yet show clear signs of the high order emotion/reasoning/awareness/intention Many who research LLMs avoid these terms in their publications for good reason (again imo)