3 ms·
It won't be coming for local inference.
by spjt 1y ago
It won't be coming for local inference.
- YetAnotherNick 1y agoIf in any case they require logging for all LLM calls, then by extension local non logged LLMs would be outlawed sooner or later.
- blibble 1y agothey'll just outlaw that entirely
- ivape 1y agoIn some countries I don't see that as unlikely. Think about it, it's such a convenient way to criminalize anyone for an arbitrary reason.
- teitoklien 1y agoWont be able to for long as smaller models keep improving performance with distillation. Once apple and co successfully embed local LLMs into their devices and custom processors it’ll be quite hard politically to reverse course.