Agreed. It's promising that Apple in particular are working on ways to run models like Stable Diffusion locally on mobile device hardware. I think they probably

Agreed. It's promising that Apple in particular are working on ways to run models like Stable Diffusion locally on mobile device hardware. I think they probably have the best chance of making that happen, given their vertical integration and hardware-centric / non-ad-based economic model. One speculative possiblity I haven't seen discussed much -- up until now, we've not seen large-scale work on hardware implementation of these NN models, since the frontier of capabilities has been advancing so fast. However, perhaps we're now approacing the first point where a baked-in-silicon (or at least part-baked) model might be economically viable. Especially if someone can figure out a way to efficiently fine-tune such a model (something like an overlay filesystem), or perhaps something like a FPGA where the underlying logical structure can be reprogrammed.