Based on what assumptions can one validly claim this is the ‘best’ solution? (In response to “The best solution to reducing the problem of Hallucinations is fi

Based on what assumptions can one validly claim this is the ‘best’ solution? (In response to “The best solution to reducing the problem of Hallucinations is first someone telling us what their Error rates in production are.”) If I were to make an educated guess, one response would be akin to “one cannot correct errors without measuring the errors at prediction time”. This is incorrect; measuring prediction errors is not the only way. Some kinds of errors can be reduced or even eliminated before they are generated. Consider the space of models that are structurally incapable of making certain classes of errors. To explain it in another way: “turning the crank on a model” isn’t the only way to reason about it. For example, in statistical modeling, there are kinds of models that do not suffer from out of sample extrapolation. Also, the ideas of trust regions (from RL) might inspire alternative methods worth exploring.