3 ms·
> Apple - their silence, but also their hardware capabilities to run LLMs > billion dollar datacenter investment that still provides a worse experience It's no
by Wytwwww 2y ago
> Apple - their silence, but also their hardware capabilities to run LLMs
> billion dollar datacenter investment that still provides a worse experience
It's not at all clear to me that those very small local models would be competing directly with large LLMs run in datacentres for the same use cases. If that's going to be the case MS/etc. would also require significantly less compute power that's is currently expected, so Nvidia would be the real losers in that case (unless they shift to consumer HW).
Also does Apple have such a huge advantage compared to the newer AMD/Intel/Google/Qualcomm(?) chips with NPUs? Yes Apple started investing sooner but all the phones/tablets and the overwhelming majority of laptops are crippled by extremely low memory capacity (in the context of running LLMs). So are they really that much ahead? e.g. what real advantages does the latest iPhone have compared to a Pixel 8 Pro (sure it's still a niche device, with a seemingly inferior an chip (but more memory) but based on what we know Google seems to be ahead in AI development and will make their solution available on all high end Android devices).
> As soon as they release something, it's
I doubt that's a given, their software has long ceased to be highly particularly exceptional and on the hardware side the only actually innovative product they have released for years has been a flop with a very unclear future.