3 ms·
It’d also be great if you guys could do a fine tune to run on an 8x80G A/H100. These H200/B200 configs are harder to come by (and much more expensive).
by azinman2 1y ago
It’d also be great if you guys could do a fine tune to run on an 8x80G A/H100. These H200/B200 configs are harder to come by (and much more expensive).
- danielhanchen 1y agoUnsloth should work on any GPU setup all the way until the old Tesla T4s and the newer B200s :) We're working on a faster and better multi GPU version, but using accelerate / torchrun manually + Unsloth should work out of the box!
- azinman2 1y agoI guess I was hoping for you guys to put up these weights. I think they’d be popular for these very large models. You guys already do a lot for the local LLM community and I appreciate it.
- danielhanchen 1y agoI'll see what I can do :)