3 ms·

Apple to Power AI Features with M2 Ultra Servers

16 points by maattp 2y ago

deleted 2y ago
[deleted]
faeriechangling 2y ago
Kind of a surprising move, since I can't imagine they're using the Ultras for training, and the 192gb m2 Ultras don't really compare to what Nvidia can deliver for inferencing. Seems like an effort to dogfood to develop their hardware/software, and to pinch pennies to me. There were some rumours about the memory capacity being bumped to 512gb and that would make sense if they were planning this.
behnamoh 2y ago
The biggest lesson of the last two years is this: There's so much INERTIA in this industry, way more inertia than what most people believed. Let me explain: In the good old GPT-3 era, we already had iOS Shortcuts that could receive voice commands from the user, send it to GPT-3 API, and show/speak the results. I had it on my Apple Watch. It was just one tap away. This made me and many enthusiasts optimistic about receiving official support of such features on the iPhone and Apple Watch. Fast forward two years later, and the AI penetration landscape doesn't look good. Apple just started thinking about "doing something" about "this AI thing" (which they don't call AI btw, but that's Apple being Apple). Google has a redundant Gemini app on stock Android which overlaps with Google Assistant capabilities (so Google Assistant is not actually equipped with large LMs yet), Alexa is still the same Alexa, and Microsoft Copilot is half-baked in terms of UI/UX (I still don't know why Microsoft can't build decent user apps). The lesson is clear: There is so much inertia in this industry that our jobs will be safe for the foreseeable future. Everyone was afraid of AI-generated content polluting the web. Well, here we are, and aside from some ridiculously obvious content which is generated by AI, the web is still the same web we knew in 2022. It's ridiculous how long ordinary users have to wait for this AI stuff to become officially available on their handheld devices by these companies. Like I said, I and many people were enjoying LLMs on iDevices way before OpenAI introduced ChatGPT and its app companion, and way way before Apple even introduces its own version. Speaking of Apple's LLM features, do you think they will be bundled with the rest of Apple One service package? Business-wise, it makes sense for Apple to charge people for iLLM/Siri Pro/ or whatever they call it.
trndlive 2y ago
Integrate with an iCloud based RAG db .. could be nice.

16 points by maattp 2y ago

deleted 2y ago

[deleted]

Kind of a surprising move, since I can't imagine they're using the Ultras for training, and the 192gb m2 Ultras don't really compare to what Nvidia can deliver for inferencing. Seems like an effort to dogfood to develop their hardware/software, and to pinch pennies to me. There were some rumours about the memory capacity being bumped to 512gb and that would make sense if they were planning this.

behnamoh 2y ago

The biggest lesson of the last two years is this: There's so much INERTIA in this industry, way more inertia than what most people believed. Let me explain: In the good old GPT-3 era, we already had iOS Shortcuts that could receive voice commands from the user, send it to GPT-3 API, and show/speak the results. I had it on my Apple Watch. It was just one tap away. This made me and many enthusiasts optimistic about receiving official support of such features on the iPhone and Apple Watch. Fast forward two years later, and the AI penetration landscape doesn't look good. Apple just started thinking about "doing something" about "this AI thing" (which they don't call AI btw, but that's Apple being Apple). Google has a redundant Gemini app on stock Android which overlaps with Google Assistant capabilities (so Google Assistant is not actually equipped with large LMs yet), Alexa is still the same Alexa, and Microsoft Copilot is half-baked in terms of UI/UX (I still don't know why Microsoft can't build decent user apps). The lesson is clear: There is so much inertia in this industry that our jobs will be safe for the foreseeable future. Everyone was afraid of AI-generated content polluting the web. Well, here we are, and aside from some ridiculously obvious content which is generated by AI, the web is still the same web we knew in 2022. It's ridiculous how long ordinary users have to wait for this AI stuff to become officially available on their handheld devices by these companies. Like I said, I and many people were enjoying LLMs on iDevices way before OpenAI introduced ChatGPT and its app companion, and way way before Apple even introduces its own version. Speaking of Apple's LLM features, do you think they will be bundled with the rest of Apple One service package? Business-wise, it makes sense for Apple to charge people for iLLM/Siri Pro/ or whatever they call it.

trndlive 2y ago

Integrate with an iCloud based RAG db .. could be nice.