3 ms·

You can run large language models locally using it: https://machinelearning.apple.com/research/neural-engine-transformers https://machinelearning.apple.com/rese

by nl 4y ago

You can run large language models locally using it: https://machinelearning.apple.com/research/neural-engine-transformers https://machinelearning.apple.com/research/neural-engine-tra... I know the Swift version of Stable Diffusion from Hugging Face uses this too.

Our_Benefactors 4y ago
While it’s true you can run some parts of a machine learning stack, Apple still lags way behind nvidia due to not having CUDA support. It makes a huge difference in both speed and quality of output.