3 ms·

For GPT they didn't pre-split into words so they definitely have something faster than quadratic! Not sure what it is though, I'm very curious.