3 ms·
Please excuse my ignorance, but what would be the use case of fine tuning? I'm quite interested in this application of it for hobby projects, but I'm not sure w
by dan_can_code 3y ago
Please excuse my ignorance, but what would be the use case of fine tuning? I'm quite interested in this application of it for hobby projects, but I'm not sure what value I would be able to gain.
- selfhoster11 3y agoFine-tuning changes how the model works, by updating model weights and changing the way it generates text. Fine-tuning is how you can turn raw base models into something that you can chat with, and into something that can follow commands. Fine-tuning can be also used to control the style of speech the model uses, and what it will be and won't be willing to discuss. To an extent, it can also teach the model to understand new things.
- euroderf 3y agoIs this how I would take a model like CodeLlama and feed it a load of code from my favorite programming language and its most useful packages ?
- selfhoster11 3y agoYes, exactly. Fine-tuning is a good way to impart this kind of knowledge to the model.