> I’m still trying to understand what is the biggest group of people that uses local AI (or will)? Well, the model makers and device manufacturers of course!

> I’m still trying to understand what is the biggest group of people that uses local AI (or will)? Well, the model makers and device manufacturers of course! While your Apple, Samsung, and Googles of the world will be unlikely to use OSS models locally (maybe Samsung?), they all have really big incentives to run models locally for a variety of reasons. Latency, privacy (Apple), cost to run these models on behalf of consumers, etc. This is why Google started shipping 16GB as the _lowest_ amount of RAM you can get on your Pixel 9. That was a clear flag that they're going to be running more and more models locally on your device. As mentioned, it seems unlikely that US-based model makers or device manufacturers will use OSS models, they'll certainly be targeting local models heavily on consumer devices in the near future. Apple's framework of local first, then escalate to ChatGPT if the query is complex will be the dominant pattern imo.