4 ms·
Yes but fine tuning requires a lot more gpu memory and is thus much more expensive, complicated and out of reach of most people. To fine tune a >10B model you s
by uniqueuid 3y ago
Yes but fine tuning requires a lot more gpu memory and is thus much more expensive, complicated and out of reach of most people. To fine tune a >10B model you still need multiple A100 / H100. Let’s hope that changes with quantized fine tuning, forward pass only etc.
- chaoyu 3y agoThe OpenLLM team is actively exploring those techniques for streamlining the fine-tuning process and making it accessible!
- quickthrower2 3y agoWhat is the $ cost of a fine tune though? $500?
- vczf 3y agoCan you fine tune on an M2 with adequate memory?
- visarga 3y agoYou can fine-tune medium models 3..60B on a single GPU with QLoRA