- from O(N²) to O(N) complexity during training wrt context length - only need the hidden state at position t to compute t+1, i.e. run inference locally on edg

- from O(N²) to O(N) complexity during training wrt context length - only need the hidden state at position t to compute t+1, i.e. run inference locally on edge devices - fine-tunable to longer context lengths than seen in pre-training If it continues to scale as well as it has so far it's pretty huge.