3 ms·
If the training data was "censored" by leaving out certain information, is there any practical way to inject that missing data after the model has already been
by ghxst 1y ago
If the training data was "censored" by leaving out certain information, is there any practical way to inject that missing data after the model has already been trained?
- heavyset_go 1y agoYou can fine tune a model with new information, but it is not the same thing as training it from scratch, and can only get you so far. You might even be able to poison a model against being fine-tuned on certain information, but that's just a conjecture.
- calaphos 1y agoIf it's just filtered out in the training sets, adding the information as context should work out fine - after all this is exactly how o3, Gemini 2.5 and co deal with information that is newer than their training data cutoff.
- selfhoster11 1y agoYes, RAG is one way to do that.