2 ms·
Asahi on previous M-series chips supports the GPU, they just don't support it on M3 yet (they have to reverse-engineer the GPU to write the driver) More info:
by brundolf 3mo ago
Asahi on previous M-series chips supports the GPU, they just don't support it on M3 yet (they have to reverse-engineer the GPU to write the driver)
More info: https://alyssarosenzweig.ca/blog/asahi-gpu-part-n.html https://alyssarosenzweig.ca/blog/asahi-gpu-part-n.html
- xrd 3mo agoOh, so an M2 will support GPU usage? Can you run CoreML and unsloth models in the same way you would use them on regular MacOS? Are there benefits to using Linux/Asahi for running models on Apple hardware?
- brundolf 3mo agoTo my understanding the M1 and M2 have very functional GPU drivers. I don't know about the other specifics you asked
- simcop2387 3mo agoYou wouldnt be using coreml since thats apples software, but likely vulkan versions of llama.cpp or pytorch or what have you. How well that works at the moment i dont know