3 ms·

To be honest, I really wish ChatGPT did have much tighter platform integrations. Every time I ask Siri a question and she fumbles it (which is most of the time)

To be honest, I really wish ChatGPT did have much tighter platform integrations. Every time I ask Siri a question and she fumbles it (which is most of the time), I long for a chatgpt smart speaker. "I found some web results" is siri speak for "I'm way dumber than chatgpt and can't solve this simple problem". But Apple - and Google I imagine - don't let 3rd party apps replace siri / "hey google". Apple and Google docking points because chatgpt doesn't have a lot of platform integrations feels like a very petty move.

wlesieutre 3y ago
https://www.macstories.net/ios/introducing-s-gpt-a-shortcut-to-connect-openais-chatgpt-with-native-features-of-apples-operating-systems/ https://www.macstories.net/ios/introducing-s-gpt-a-shortcut-...
miki123211 3y ago
This isn't just about "replacing Siri", to do that successfully, Chat GPT would need almost root-level access to your device. Things like constant background microphone usage, the ability to work on the Lock Screen, make calls, send texts etc without an extra prompt, get access to intents from third-party apps, all of this would either require separate APIs (which come with compatibility promises and hence lots of deliberation) or the ability to run apps unsandboxed, and would have serious privacy implications either way. edit: With that said, if Chat GPT came before iOS, I'm pretty sure Apple would have had to design iOS with that use case in mind and get these APIs exposed somehow, maybe even through a direct integration with OpenAI or Anthropic.
- josephg 3y ago
  Sure; but on reflection I don’t really care about chatgpt being able to make calls and play / pause apple music. I just want a way to invoke chatgpt with my voice from a locked phone and go straight into a chatgpt conversation. ChatGPT’s strength is open ended questions, storytelling and synthesis of information. Not its ability to set an oven timer. Now, that would definitely still take some work from Apple. Right now as I understand it the device listens for “Siri…” all the time using some on-device ML. They’d need a way for that to work with chatgpt and hand over to the audio stream. And have a chatgpt conversation from a lock screen without breaking sandboxing. But all of that would definitely make my phone a much more useful device. I won’t hold my breath though.
danpalmer 3y ago
> don't let 3rd party apps replace siri / "hey google" I think it's reasonable that they don't let you replace the logic behind their branding – it would be quite a serious issue if ChatGPT started giving offensive results when you ask "Hey Siri". Whether they should allow replacing the voice assistant entirely is an interesting question. On Android OEMs can of course do this, and have done so with mixed success, see "Bixby". The issue with LLMs is that they are slow. People expect a response immediately, so much so that Amazon Alexa built much of its popularity as a kitchen timer over the alternative because it's just fast. I think it's a much more reasonable argument that the reason Alexa, Siri, Google Assistant, Bixby, and Cortana (not sure if that exists anymore?) don't use LLMs is not that Amazon/Apple/Google/Samsung/Microsoft are asleep at the wheel, but that LLMs are not suitable yet. I'm sure this is coming, but I'm not surprised none of them have it yet.

wlesieutre 3y ago

https://www.macstories.net/ios/introducing-s-gpt-a-shortcut-to-connect-openais-chatgpt-with-native-features-of-apples-operating-systems/ https://www.macstories.net/ios/introducing-s-gpt-a-shortcut-...

miki123211 3y ago

This isn't just about "replacing Siri", to do that successfully, Chat GPT would need almost root-level access to your device. Things like constant background microphone usage, the ability to work on the Lock Screen, make calls, send texts etc without an extra prompt, get access to intents from third-party apps, all of this would either require separate APIs (which come with compatibility promises and hence lots of deliberation) or the ability to run apps unsandboxed, and would have serious privacy implications either way. edit: With that said, if Chat GPT came before iOS, I'm pretty sure Apple would have had to design iOS with that use case in mind and get these APIs exposed somehow, maybe even through a direct integration with OpenAI or Anthropic.

josephg 3y ago
Sure; but on reflection I don’t really care about chatgpt being able to make calls and play / pause apple music. I just want a way to invoke chatgpt with my voice from a locked phone and go straight into a chatgpt conversation. ChatGPT’s strength is open ended questions, storytelling and synthesis of information. Not its ability to set an oven timer. Now, that would definitely still take some work from Apple. Right now as I understand it the device listens for “Siri…” all the time using some on-device ML. They’d need a way for that to work with chatgpt and hand over to the audio stream. And have a chatgpt conversation from a lock screen without breaking sandboxing. But all of that would definitely make my phone a much more useful device. I won’t hold my breath though.

danpalmer 3y ago

> don't let 3rd party apps replace siri / "hey google" I think it's reasonable that they don't let you replace the logic behind their branding – it would be quite a serious issue if ChatGPT started giving offensive results when you ask "Hey Siri". Whether they should allow replacing the voice assistant entirely is an interesting question. On Android OEMs can of course do this, and have done so with mixed success, see "Bixby". The issue with LLMs is that they are slow. People expect a response immediately, so much so that Amazon Alexa built much of its popularity as a kitchen timer over the alternative because it's just fast. I think it's a much more reasonable argument that the reason Alexa, Siri, Google Assistant, Bixby, and Cortana (not sure if that exists anymore?) don't use LLMs is not that Amazon/Apple/Google/Samsung/Microsoft are asleep at the wheel, but that LLMs are not suitable yet. I'm sure this is coming, but I'm not surprised none of them have it yet.