2 ms·
You would fine tune a pretrained LLM because those books are written in English. And natural languages are in flux, and the corpuses that describe them are not
by esafak 3y ago
You would fine tune a pretrained LLM because those books are written in English. And natural languages are in flux, and the corpuses that describe them are not neutral, so you can impose fairness after the fact. Sebastian Raschka has written some relevant popular articles, like:
https://magazine.sebastianraschka.com/p/understanding-large-language-models https://magazine.sebastianraschka.com/p/understanding-large-...
https://magazine.sebastianraschka.com/p/finetuning-large-language-models https://magazine.sebastianraschka.com/p/finetuning-large-lan...