4 ms·
Nice. Unsloth requires a platform supported by Triton, correct?
by hedgehog 2y ago
Nice. Unsloth requires a platform supported by Triton, correct?
- danielhanchen 2y agoYep! Linux works - Windows works if you manually compile it, or use an unofficial Python wheel. I'm actually unsure if Mac devices support Triton.
- hedgehog 2y agoI think basically only NVIDIA is reliably supported right now, it would be nice to have more hardware support to allow splitting models (like HF Accelerate or llama.cpp support).
- danielhanchen 2y agoYep for now NVIDIA - AMD might work but I'll have to edit the dependencies - more hardware support is coming! I'm trying to add Apple and CPU support!