What? Transformer model is a standard industry term for a particular machine learning model architecture: https://en.wikipedia.org/wiki/Transformer_(machine_lea

What? Transformer model is a standard industry term for a particular machine learning model architecture: https://en.wikipedia.org/wiki/Transformer_(machine_learning_model) https://en.wikipedia.org/wiki/Transformer_(machine_learning_... At 34M parameters, it's not very large. A LLM can be a transformer model, but also it can have a different architecture (e.g. RNN, such as RWKV). Apple has been using RNNs for many things, I believe it's the first time they're shipping an on-device transformer model.