2 ms·
Jeremy Howard talks about it in his recent video "A Hackers' Guide to Language Models": https://youtu.be/jkrNMKz9pWU?t=4808 https://youtu.be/jkrNMKz9pWU?t=4808
by code_biologist 3y ago
Jeremy Howard talks about it in his recent video "A Hackers' Guide to Language Models": https://youtu.be/jkrNMKz9pWU?t=4808 https://youtu.be/jkrNMKz9pWU?t=4808
That link goes directly to the timestamp where he discusses fine tuning, but the whole talk is great. Punchline, check out Axolotl: https://github.com/OpenAccess-AI-Collective/axolotl https://github.com/OpenAccess-AI-Collective/axolotl
- vjb2tq4dws 3y agoThis is a walkthrough based on that talk for fine-tuning with axolotl https://dzlab.github.io/dltips/en/pytorch/llama-2-finetuning-axolotl/ https://dzlab.github.io/dltips/en/pytorch/llama-2-finetuning...