3 ms·
Here's a vram requirements table for fine-tuning an LLM: https://github.com/hiyouga/LLaMA-Factory?tab=readme-ov-file#hardware-requirement https://github.com/hiy
by michaelt 3y ago
Here's a vram requirements table for fine-tuning an LLM: https://github.com/hiyouga/LLaMA-Factory?tab=readme-ov-file#hardware-requirement https://github.com/hiyouga/LLaMA-Factory?tab=readme-ov-file#...
No matter how much vram you have, there's something that doesn't fit :)
- throwing_away 3y agoThis is also how I learned that 8X7B doesn't mean "eight 7B models joined somehow".