3 ms·
I see... I'm a little out of my depth, but I did see that Meta has some documentation that talks about fine-tuning using LoRA and QLoRA, and at a glance it soun
by BaculumMeumEst 2y ago
I see... I'm a little out of my depth, but I did see that Meta has some documentation that talks about fine-tuning using LoRA and QLoRA, and at a glance it sounds like its doable on consumer hardware. Are you familiar with those? Am I misunderstanding? https://llama.meta.com/docs/how-to-guides/fine-tuning/ https://llama.meta.com/docs/how-to-guides/fine-tuning/
- lostmsu 2y agoBoth still compute FP16 gradients. It comes back to the original point that Mac is just going to be too slow even on 8B model.