3 ms·
Can you expand on this a bit? My recent experiences with MLX have been really positive, so I'm curious what footguns you're alluding to here. (I don't do most
by spmurrayzzz 2y ago
Can you expand on this a bit? My recent experiences with MLX have been really positive, so I'm curious what footguns you're alluding to here.
(I don't do most of my work locally, but for smaller models its pretty convenient to work on my mbp).
- sigmoid10 2y agoMPS implementations generally lag behind CUDA kernels, especially for new and cutting edge stuff. Sure, if you're only running CPU inference or only want to use the GPU for simple or well established models, then things have gotten to the point where you can almost get the plug and play experience on Apple silicon. But if you're doing research level stuff and training your own models, the hassle is just not worth it once you see how convenient ML has become in the cloud. Especially since you don't really want to store large training datasets locally anyways.