4 ms·
The bubble bursts when Apple announces it's doing good enough (private/secure) LLMs on device. At that point the capex on cloud infra starts to come into questi
by idkwhattocallme 1y ago
The bubble bursts when Apple announces it's doing good enough (private/secure) LLMs on device. At that point the capex on cloud infra starts to come into question and the dominos start to fall...
- fao_ 1y agoGoogle's been doing this since at least 2022 and... well, nobody really cares.
- goalieca 1y agoLLM to me are the least interesting part of AI. Deep learning has proven very useful for signal processing and image segmentation among other things. Those are small enough to run on phones. LLM simply don’t seem to be that useful at small scales because the illusion of knowledge falls apart with too few parameters.
- kelipso 1y agoYeah, it’s only a matter of time till LLMs can easily be run locally by more people and once the market realizes that it’s over.
- gtirloni 1y agoYou can't run anything close to ChatGPT levels of parameters locally though.
- mscbuck 1y agoAs laughable as Apple's efforts have been so far, I think they still have an advantage precisely because of the unified architecture.