3 ms·
Seems like marketing hype? Surely running local LLMs isn’t that big a market.
by digitcatphd 2y ago
Seems like marketing hype? Surely running local LLMs isn’t that big a market.
- binkHN 2y ago> Surely running local LLMs isn’t that big a market. Agreed. That said, if you do AI/LLMs, few, if any, portable non-Mac systems have the ability to pull this off. The Macs just crush it when it comes to GPU and memory bandwidth performance, and they do this while sipping battery life.
- fragmede 2y agoRight now there's not, but the market for smartphones was pretty small until the iPhone came out. If anybody could create a market for something, I'd believe Apple could do it.
- lxgr 2y agoAn LLM able to e.g. summarize the gist of a long text conversation in a group chat that I missed, able to understand queries like "what time did X say we'd meet up, and how long would it take me to get there" etc. would be incredibly useful to me. Sure, most of that is possible server-side – but the appeal would be that local processing could preserve a lot more privacy.
- chaostheory 2y agoYou underestimate how much people hate the guardrails for the cloud AIs.
- weikju 2y agoIt’s not like Apple won’t have guardrails in their local llms…