2 ms·
> LLM models are usually modified by changing the model weights directly, instead of retraining the model from scratch. LLM weights are poorly understood, but t
by lmm 3y ago
> LLM models are usually modified by changing the model weights directly, instead of retraining the model from scratch. LLM weights are poorly understood, but this is an unavoidable side effect of the development methodology, not deliberate obfuscation.
They're understood based on knowing the training process though, and a developer working on them would want to have the option of doing a partial or full retraining where warranted.