6 ms·
No surprise. Apple likely wants to run LLMs on their devices and provide developers with the possibility to create iOS apps using that. C++ is essential in that
by whirlwin 3y ago
No surprise. Apple likely wants to run LLMs on their devices and provide developers with the possibility to create iOS apps using that. C++ is essential in that sense.
- pjmlp 3y agoThis is to ease code migration, similar to the original Objective-C interoperability.
- saagarjha 3y agoI think it’s more likely they have a lot of C++ they want to migrate to Swift
- checker659 3y agoLike what? Surely they're not re-writing their audio stack in Swift?
- wiseowise 3y agoNot sure if sarcasm, but why not? https://youtu.be/ZQc9-seU-5k?si=t8Ohv7M51UNuDqgx https://youtu.be/ZQc9-seU-5k?si=t8Ohv7M51UNuDqgx
- checker659 3y agoApple uses C++ primarily for device drivers and latency critical stuff in the userspace. I was genuinely curious if that's what OP meant.
- nxobject 3y agoI wouldn’t be surprised if it was for other drivers, actually, especially since Apple’s really pushing cross-OS user space drivers, and why not use the opportunity to do 2 tech refreshes? If Apple’s trying to push iPadOS drivers to make the iPad a “real computer”, why not lower the barrier to entry?
- deleted 3y ago[deleted]
- zer0zzz 3y agoYes
- checker659 3y agoThat's interesting
- riwsky 3y agoiOS AI apps are dead in the water until Apple releases Fortran APIs
- meindnoch 3y agoWhat are you even talking about?
- whirlwin 3y agoRunning AI models on edge devices is already here. This is just one example https://github.com/ggerganov/llama.cpp https://github.com/ggerganov/llama.cpp With Swift language bindings it would be quite smooth to work towards.