3 ms·
You can definitely unlearn things with respect to LLM. You retrain. It’s expensive for them, boo hoo.
by endisneigh 3y ago
You can definitely unlearn things with respect to LLM. You retrain. It’s expensive for them, boo hoo.
- minimaxir 3y agoLLMs can't "unlearn" even with additional finetuning. Content drifts towards the newly added material, yes, but it can't forget, and artifacts will still be present.
- maxglute 3y agoI think they meant retrain from ground up. Clean room implementation. Technically feasible but not business feasible. Otherwise learn NDA and get sued for breaking it in the future.
- StreetChief 3y agoyou can start from scratch, but you cannot unlearn.