4 ms·
But when the text does indicate that our hypothetical 78 year old is forgetful, the de-biased model is less accurate. Check the two rightmost columns under "bia
by Manuel_D 2y ago
But when the text does indicate that our hypothetical 78 year old is forgetful, the de-biased model is less accurate. Check the two rightmost columns under "bias unlearning results".
The de-biased model was less likely to give the biased answer in ambiguous prompts, but at the expense of reluctance to give the "biased" response when the prompt indicates that it was true.
- notahacker 2y agoYes, it has the standard LLM trait that when you nudge it to stop being confidently wrong based on insufficient information, it also tends to be less assertive when it actually has sufficient information. But I'm not sure why anyone would prefer a model which parses sentences as containing information that isn't there 30-50% of the time to a model which gives false negatives 4-10 %age points more often when given relevant information (especially since the baseline model was already too bad at identifying true positives to be remotely useful at that task)