14 ms·
Can this be optimized so training of larger variants is possible with a pair of 3090 or 4090?
by DeathArrow 2y ago
Can this be optimized so training of larger variants is possible with a pair of 3090 or 4090?
- qayxc 2y agoThis would involve a lot of effort, but seems to be doable. Here's a starting point that discusses some options: https://huggingface.co/blog/trl-peft https://huggingface.co/blog/trl-peft