5 ms·
I hope this amount of effort means multi-GPU support is coming soon (saw you mention “this week” :) ) so we can tune QwQ on a single node!
by kiratp 2y ago
I hope this amount of effort means multi-GPU support is coming soon (saw you mention “this week” :) ) so we can tune QwQ on a single node!
- danielhanchen 2y agoYes!! Technically it's already in Unsloth :) I'm still trying to make the frontend for running multi GPU better!