4 ms·
Apple Closes in on Deal with OpenAI to Put ChatGPT on iPhone
- amelius 3y agoAnyone else worried about the apparent non-orthogonality here? Why do we need Apple's approval for using third party services on the hardware we own?
- stefan_ 3y agoDoes seem like another browser/search integration debacle. Makes you wonder which side is getting paid between Apple and OpenAI.
- CharlesW 3y agoThis is about Apple tying 3rd-party capabilities directly into the OS. You can use ChatGPT (or whatever) via several existing extensibility mechanisms right now — Siri, Shortcuts, the Action Button, Share Sheets, etc. — with apps which have done the integration work. https://help.openai.com/en/articles/7993358-chatgpt-ios-app-siri-and-shortcuts https://help.openai.com/en/articles/7993358-chatgpt-ios-app-...
- jerbear4328 3y agohttps://archive.is/lrzGb https://archive.is/lrzGb
- mft_ 3y agoI'm interested to see how they handle the financial side of whatever extra LLM features they start to offer. Free, like Siri? Free to a point, then payment needed? Limited abilities are free? Subscription only?
- Donald 3y agoMy guess is that they host a version of the model locally on the iPhone.
- mft_ 3y agoMaybe a very cut down version - any of the more recent and capable OpenAI models are surely far too large to put on an iPhone, and far too large to run (in terms of both memory available, and processing power). This would maybe align with the 'limited abilities are free' approach.
- eyelidlessness 3y agoEven if they don’t (or if it’s partially networked as some recent rumors suggest), it’ll be rolled into one or both of two predictable costs (to the consumer): 1. The device sale itself, either raising the ASP or offsetting some other cost (to Apple) savings 2. Recurring payments for iCloud (or any rebranding it might undergo along with the feature) Apple’s pricing model, if not totally predictable, is exceedingly formulaic. If they deviate from these into some sort of nickel and diming on “AI” features alone, that would almost certainly be a clear sign that they’re betting against it as a long term selling point.
- sharma-arjun 3y agoThis indeed seems to have been a heavy focus of their research team in the past year, eg. "Efficient Large Language Model Inference with Limited Memory" [1] and OpenELM [2] [1] https://arxiv.org/pdf/2312.11514 https://arxiv.org/pdf/2312.11514 [2] https://arxiv.org/pdf/2404.14619 https://arxiv.org/pdf/2404.14619 (with 1.1B parameters, this appears to be their attempt at building a lightweight LLM)
- sureIy 3y agoI would have never expected this. I thought no one had a moat in AI, so why can’t Apple just use/extend one of the existing open solutions? Also, how does Apple deal with providing Siri data to a third party?
- jsheard 3y agoIf anyone can strong-arm OpenAI into letting them self-host their models, it's Apple.
- stavros 3y agoHow can apple strongarm OpenAI?
- jsheard 3y agoThe same way they strong-arm TSMC into giving them exclusive first dibs on new process nodes - by having more money than God and making an offer they can't refuse.
- stavros 3y agoYou and I have very different definitions of the word "strong-arm". By that definition, I just strong-armed Apple into giving me an iPhone by giving them $1200.
- sureIy 3y agoNot the same. If Apple pays OpenAI, it won’t give them 0.001% of their profits, but something like 20%. If your iPad is worth 20% of Apple’s profits, you bet Tim will be hand-holding you through the obnoxious setup process.
- stavros 3y agoMe buying something is different from Apple buying something because the two things have different prices? To strong-arm someone means to impel them by physical force, especially against resistance, not to give them so much money they'll be happy to cooperate. That's basically the exact opposite of strong-arming.
- Waterluvian 3y agoMaybe I’m dim today but I can’t tell if they mean via API or running locally in some manner. I guess if it’s local, it wouldn’t actually be the GPT we know. I’ve been very excited about the idea that Apple takes a stab at having it run locally, because it would help improve what I consider to be by far the largest UX issue: the awkward latency.
- dantyti 3y agoFor most of my use cases, the privacy impact of sending LLM queries to someone else is a larger UX issue
- dbish 3y agoFor Apple, they know the average person doesn’t really care about this. They only lean into privacy when it’s a useful competitive weapon. There are many people willing to pay for products now that record their screen 24/7, or buy “AI” wearables that are just open mics. The Overton window shifted for privacy concerns somewhere between Google Glass (where people were barred from locations) and now. Still, it wouldn’t surprise me if they work with openai to release less powerful local models just for simple Siri use cases so they can keep using privacy for marketing.
- amelius 3y ago> For Apple, they know the average person doesn’t really care about this. This is one sad thing about the free market: everybody is _not_ average in one way or the other, but all we get are products made for average people, so in the end everybody is a little bit unhappy. Some people are far from average, therefore they must be very unhappy. Now if only the products we bought weren't so much locked down, we could modify them and use them however we wanted to.
- dbish 3y agoIt would be nice if Apple products were less locked down. Android is the only option if you want that sadly for the phone space
- dantyti 3y agoSeeing how few things can be done/automated on a locked iPhone even when using Shortcuts, I don’t expect this to go beyond a better autosuggest for text. Which is fine, killing the AI hype might just work out for eveyone.
- input_sh 3y agoDupe: https://news.ycombinator.com/item?id=40325876 https://news.ycombinator.com/item?id=40325876 https://news.ycombinator.com/item?id=40325382 https://news.ycombinator.com/item?id=40325382 https://news.ycombinator.com/item?id=40322104 https://news.ycombinator.com/item?id=40322104
- endymi0n 3y agoThey were also in talks with Gemini lately: https://9to5google.com/2024/05/10/google-apple-gemini-discussions-report/ https://9to5google.com/2024/05/10/google-apple-gemini-discus... I find it a bit weird that Apple with its massive market share and RnD budget apparently wasn‘t able to get a team and traction (or at least any significant acquisitions or acquihires) on AI with the writing being on the wall since quite some time now. Makes me a bit worried about their privacy angle and that it might disappear.
- londons_explore 3y agoTheir privacy angle is 100% the reason they haven't managed to make a decent LLM. To make a decent LLM you need to ignore data protection and throw all available text into a huge model. If your morals don't let you do that, then you can't make your own LLM.
- gumby271 3y agoBut you can partner with a 3rd party to submit all that text to, and pretend your still privacy conscience? Pretty sure people would rather Apple build a first party server based option than partner with anyone else. When it's Apple violating privacy people are more chill about it.
- timr 3y agoOr you get the model and host it on your own hardware. The sort of thing an Apple might be able to do.
- dns_snek 3y ago> If your morals don't let you do that, then you can't make your own LLM. You're reaching, a lot. Apple is more privacy-friendly than most companies at the moment - no argument there, but they still sell your privacy on the web to Google in exchange for a 36% cut of advertising revenue [1] which amounts to ~$20 billion [2], or a rather petty amount of ~$10/device [3]. These same "morals" also allow them to hand over data on all Chinese citizens to the CCP, among countless other privacy-destroying compromises they have to make in order to profit from the Chinese market [4] [1] https://arstechnica.com/tech-policy/2023/11/google-witness-accidentally-blurts-out-that-apple-gets-36-cut-of-safari-deal/ https://arstechnica.com/tech-policy/2023/11/google-witness-a... [2] https://www.bloomberg.com/news/articles/2024-05-01/google-s-payments-to-apple-reached-20-billion-in-2022-cue-says https://www.bloomberg.com/news/articles/2024-05-01/google-s-... (https://archive.is/oPg1C https://archive.is/oPg1C) [3] https://www.theverge.com/2023/2/2/23583501/apple-iphone-ipad-active-2-billion-devices-q1-2023 https://www.theverge.com/2023/2/2/23583501/apple-iphone-ipad... [4] https://www.nytimes.com/2021/05/17/technology/apple-china-censorship-data.html https://www.nytimes.com/2021/05/17/technology/apple-china-ce... (https://archive.is/MQmY7 https://archive.is/MQmY7)
- outside1234 3y agoI thought OpenAI had an exclusive with Microsoft? Or is that expiring?
- sameermanek 3y agoSo what are they releasing in this WWDC exactly? I heard it was all about on device AI
- CharlesW 3y agoWhen possible. Apple already has a hybrid model — for example, Series 9 and Ultra 2 can do many things with Siri completely on-device, but (as with pre-S9-chip devices) still leverage a more powerful device when needed. I predict they're generalizing this as a framework that automatically passes and returns requests according to some heuristic of quality + privacy + latency. Even local devices like Macs and HomePods may participate in this "AI mesh".
- tracerbulletx 3y agoCurious to see the specifics and terms of any such deal before speculating if it's a good or a bad thing, for users, and for Apple.
- whartung 3y agoWhat I want in 2 years on the iPhone 17 is “Listen up, Siri” At which point it just starts recording a voice memo until we tell it we’re done. Then it summarizes what it’s heard into todo items, grocery lists, list of potential appointments or stops to make. It manages to deal with the pauses, the umms, the stammering, the “let’s get some orange soda. No, wait, make that grape.” Basically, listen in to my wife and I talk about our day and summarize it into action items.
- amelius 3y agoDoesn't Samsung already offer this, with a note-taking app for meetings?
- hu3 3y agoYes and it can translate on the fly as well. https://www.samsung.com/us/support/answer/ANS10000942/ https://www.samsung.com/us/support/answer/ANS10000942/
- Gys 3y agoCheck https://apps.apple.com/nl/app/whisper-memos-speech-to-text/id6443658039?l=en-GB https://apps.apple.com/nl/app/whisper-memos-speech-to-text/i...
- laurels-marts 3y agoFrankly I find this a bit disappointing.
- deleted 3y ago[deleted]
- staplers 3y agoThe countdown to a controversial privacy violation begins. Makes you wonder if this will be baked in or if they'll give users the ability to opt-out of data sharing on a self-proclaimed "private" OS.
- atenni 3y agoA lot of people here are assuming this will involve API calls to OpenAI’s servers. If a deal is made it will almost certainly be to self host OpenAI’s models, the same way Microsoft does. Apple will use RAG to ground requests in the user’s own iCloud data, and no user data will be sent to OpenAI or be used to train any OpenAI models.
- ChrisArchitect 3y ago[dupe] Some more discussion: https://news.ycombinator.com/item?id=40322104 https://news.ycombinator.com/item?id=40322104