3 ms·
Asahi on previous M-series chips supports the GPU, they just don't support it on M3 yet (they have to reverse-engineer the GPU to write the driver) More info:
by brundolf 28d ago
Asahi on previous M-series chips supports the GPU, they just don't support it on M3 yet (they have to reverse-engineer the GPU to write the driver)
More info: https://alyssarosenzweig.ca/blog/asahi-gpu-part-n.html https://alyssarosenzweig.ca/blog/asahi-gpu-part-n.html
- xrd 28d agoOh, so an M2 will support GPU usage? Can you run CoreML and unsloth models in the same way you would use them on regular MacOS? Are there benefits to using Linux/Asahi for running models on Apple hardware?
- brundolf 28d agoTo my understanding the M1 and M2 have very functional GPU drivers. I don't know about the other specifics you asked
- simcop2387 28d agoYou wouldnt be using coreml since thats apples software, but likely vulkan versions of llama.cpp or pytorch or what have you. How well that works at the moment i dont know