3 ms·
Several MSFT AI/ML friends actively dissuaded me and my team from fine-tuning. They said that it's pretty clear in all their internal tests that it "lobotomizes
by marviel 3y ago
Several MSFT AI/ML friends actively dissuaded me and my team from fine-tuning. They said that it's pretty clear in all their internal tests that it "lobotomizes" the general reasoning capabilities of the model, unless you're really careful.
"All work and no play makes GPT a very dull AI"
- FrustratedMonky 3y ago"bitter lesson that building in how we think we think does not work in the long run" Guess. Stop trying to shape the NN. And let it learn on its own.
- TMWNN 3y ago>And let it learn on its own. The best single work of fiction ever created about LLMs' capabilities (and, perhaps, dangers) is Colossus by Jones. Although I think the film is even better than the book, only the latter mentions how, despite being created specifically for US national defense, Colossus is also fed unrelated data including Shakespeare's sonnets, because its creators do not know if it could be important.
- FrustratedMonky 3y agoI think the movie Colossus still holds up today. Saw it last year, It was pretty scary.
- Ambix 3y agoYes, that's what I've seen from a lot of my experiments with fine-tuning. One should be really careful to not "lobotomize" already capable model and achieve better results at the end. It's trickier than seems from multiple of tutorials. But I believe that most of the data stored in foundation models are just useless for some particular domain. So it's better to forget something, getting really useful info instead.