Running (quantised) LLMs (encoder-decoder and decoder only transformers) on phones isn't hard. Running CNNs and encoder-only transformers, the kind used in visi

Running (quantised) LLMs (encoder-decoder and decoder only transformers) on phones isn't hard. Running CNNs and encoder-only transformers, the kind used in vision on phones is even easier.