does it? I wouldn't expect an LLM that was trained with care to answer based on context, and to exclude bias to still be able to answer correctly when provided

does it? I wouldn't expect an LLM that was trained with care to answer based on context, and to exclude bias to still be able to answer correctly when provided with context. Did I miss something and there's a reason to suspect that fine tuning to remove bias would also prevent it from predicting based on provided context? Or did you just make up that example because it might be interesting if it was true?