4 ms·
Fine-tuning changes how the model works, by updating model weights and changing the way it generates text. Fine-tuning is how you can turn raw base models into
by selfhoster11 3y ago
Fine-tuning changes how the model works, by updating model weights and changing the way it generates text.
Fine-tuning is how you can turn raw base models into something that you can chat with, and into something that can follow commands. Fine-tuning can be also used to control the style of speech the model uses, and what it will be and won't be willing to discuss. To an extent, it can also teach the model to understand new things.
- euroderf 3y agoIs this how I would take a model like CodeLlama and feed it a load of code from my favorite programming language and its most useful packages ?
- selfhoster11 3y agoYes, exactly. Fine-tuning is a good way to impart this kind of knowledge to the model.