Centralized vs distributed feels like a largely orthogonal matter. E.g. phones are great at being clients, even for things which they could technically be the s

Centralized vs distributed feels like a largely orthogonal matter. E.g. phones are great at being clients, even for things which they could technically be the server for today, but they make pretty bad servers in terms of resource tradeoffs. Because of this, I think the endgame cares little about where the LLM runs as much as how much it costs for those devices to use one (which can be more than just money too - e.g. on phones it's battery, bandwidth, latency, privacy, or whatever else could be valued/scarce). That it's specifically on device is just one method of how to meet some of these attributes, not the exclusive method to use it. Even as a techie tinkerer my dream is not that every device I have run its own LLM - it's that I can point them to where to find the LLM (and swap that at will). The dumber I can make my edges the more they can end up doing overall.