4 ms·
LLMs can't "unlearn" even with additional finetuning. Content drifts towards the newly added material, yes, but it can't forget, and artifacts will still be pre
by minimaxir 3y ago
LLMs can't "unlearn" even with additional finetuning. Content drifts towards the newly added material, yes, but it can't forget, and artifacts will still be present.
- maxglute 3y agoI think they meant retrain from ground up. Clean room implementation. Technically feasible but not business feasible. Otherwise learn NDA and get sued for breaking it in the future.