2 ms·
I wonder if using Apple’s new MLX Python library (for training on unified memory systems) would yield significant gains.
by a_wild_dandan 3y ago
I wonder if using Apple’s new MLX Python library (for training on unified memory systems) would yield significant gains.
- nl 3y agoThis (the device='mps' version) already uses the unified memory plus GPU on M-series Macs. It's possible MLX has some additional micro optimizations, but in general most people who have tried it out against hand-written MPS based training implementations haven't found great speed ups yet.