4 ms·
Apple is well supported in that it's "better than everyone except Nvidia", and that's really only because a bunch of well known boutique developers seem to like
by Der_Einzige 3y ago
Apple is well supported in that it's "better than everyone except Nvidia", and that's really only because a bunch of well known boutique developers seem to like the high quality of apple laptops and refuse to budge about mainly developing on them.
Still, trying to do significantly fun or interesting things in any major AI ecosystem, such as the Stable Diffusion one through Automatic1111 or with the LLMs in Oobabooga (which supports nearly all LLM backends i.e. llama.cpp), will be mostly crippled and stuff will break in ways that simply don't happen to Nvidia hardware. I'll take the 2 4090s all day, because I know that quantization techniques which shouldn't even be possible (who knows maybethe fabled 1 bit quantization seems inevitable at this point) will make it possible for me to stuff even the most bloated LLM into my measly 48 GBs will be available on Nvidia first and Apple (maybe) second.
- J_Shelby_J 3y agoI bring this up all the time and get downvoted by apple defenders (usually I’m one). Apples policy of locking out 3rd party gpus might be the cause of a serious decline in Mac OS over the next decade. That or devs will start building Linux hosts for their gpus at home.
- tracerbulletx 3y agoThat doesn't really make sense, if anything the importance of having third party cards is diminishing. Apple Silicon is already massively competitive at running things like Blender and Video Compositors. And the trends are towards apple investing in improving gaming and ML workloads (which they've made large strides towards this year), and the relative attractiveness of other GPUs is going down. Almost all of the signs are pointing at apple making their hardware the place to run on device ml.