4 ms·
what is the best way to fine-tune these models? any good resources would be very helpful. TIA /\ PS - I have a brief background in Machine Learning, more in de
by Nischalj10 3y ago
what is the best way to fine-tune these models? any good resources would be very helpful. TIA /\
PS - I have a brief background in Machine Learning, more in development.
- code_biologist 3y agoJeremy Howard talks about it in his recent video "A Hackers' Guide to Language Models": https://youtu.be/jkrNMKz9pWU?t=4808 https://youtu.be/jkrNMKz9pWU?t=4808 That link goes directly to the timestamp where he discusses fine tuning, but the whole talk is great. Punchline, check out Axolotl: https://github.com/OpenAccess-AI-Collective/axolotl https://github.com/OpenAccess-AI-Collective/axolotl
- vjb2tq4dws 3y agoThis is a walkthrough based on that talk for fine-tuning with axolotl https://dzlab.github.io/dltips/en/pytorch/llama-2-finetuning-axolotl/ https://dzlab.github.io/dltips/en/pytorch/llama-2-finetuning...