Yes, this may (significantly) improve that. Even without that, you can run LLMs already on mobile phones, the question is just how big of a model and how strong

Yes, this may (significantly) improve that. Even without that, you can run LLMs already on mobile phones, the question is just how big of a model and how strongly quantized, and if the few models that remain produce good enough results. E.g. there was a GH Discussion about running LLMs on Apple A-series chips (iPhone) posted here yesterday: https://news.ycombinator.com/item?id=38703161 https://news.ycombinator.com/item?id=38703161