11 ms·

How to talk to GPT-3 through Siri

108 points by kolchinski 4y ago

After getting frustrated with Siri's inability to answer pretty basic questions with actual answers instead of "I searched the web for you", I figured out how to get GPT-3 integrated pretty seamlessly with Siri. Sharing it here in case it's useful for anyone else! You can see the short writeup with instructions here: https://alexkolchinski.com/2023/02/03/how-to-talk-to-gpt-3-through-siri/ https://alexkolchinski.com/2023/02/03/how-to-talk-to-gpt-3-t... The Siri shortcut is here: https://www.icloud.com/shortcuts/b10d3d361a3f48428a2ed8fe729dc4fa https://www.icloud.com/shortcuts/b10d3d361a3f48428a2ed8fe729... (You'll need to add your OpenAI API key to the shortcut and update your Siri accessibility settings to get it to work smoothly – see the above-linked blog post for more detailed instructions.)

serpix 4y ago
My problem with Siri is that it doesn't understand speech. I am non native speaker but coming from Android I had no problems with Google in understanding what I am saying. It just does not understand or completely alters the phrase.
- marcellus23 4y ago
  If you're not a native English speaker, have you tried changing the langauge in Settings > Siri & Search? Either to your native language, or to a regional variant of English that more closely matches your accent?
  - scarface74 4y ago
    I am learning Spanish and the iOS translate app can’t understand my very bad Spanish. It understands my native language - English - almost perfectly.
- anaganisk 4y ago
  Unlike Google Assistant, Siri comes from the Apple ecosystem. Apple has a very weak market share in non US countries. Google is where it is because of its huge market share and their ability to capture a lot of data. If Apple is adopted more and more, I dont think Siri will be so bad. They can also train it better with non native accents.
s3p 4y ago
Great work. Just set it up with my API key. Not sure how often I'll be asking siri complex questions, but useful to have either way. Thanks for publishing this on HN!
dsabanin 4y ago
If you change model name in OpenAI request to "text-chat-davinci-002-20230126" and use "<|im_end|>" as a stop, and use this prompt, it will respond like ChatGPT: You are ChatGPT, a large language model trained by OpenAI. You answer as concisely as possible for each response (e.g. don’t be verbose). It is very important that you answer as concisely as possible, so please remember this. If you are generating a list, do not have too many items. Keep the number of items short.
- graiz 4y ago
  That would be cool, but no. "error": { "message": "That model does not exist", "type": "invalid_request_error", "param": null, "code": null }
  - dsabanin 4y ago
    Oh well, it was working pretty well while it lasted.
- mritchie712 4y ago
  > "text-chat-davinci-002-20230126" https://github.com/acheong08/ChatGPT/issues/523 https://github.com/acheong08/ChatGPT/issues/523
frietzkriesler2 4y ago
Solid work, now we need someone to make a Majel Barret ai voice clone to replace Siri's annoying "I'm a helpful person but not really" voice as well as chapgpts verbosity when asking it certain questions and we will FINALLY have a star trek TNG like computer assistant.
avivo 4y ago
Has anyone gotten this to speak back a response on a Mac? I don't see a setting for this. I'm also curious if there are ways to do this for Google Home and Alexa.
- kaliara 4y ago
  You can use the "Make spoken audio from" and "play audio file" actions available to Shortcuts. I was able to get it to play from the Mac dock using this method. Screenshot: https://imgur.com/a/EFdyAxF https://imgur.com/a/EFdyAxF
dreadlordbone 4y ago
I've been using my own version of this for a while - it's excellent when you are driving and don't want to have Siri yell at you for asking it something it needs web results for.
criddell 4y ago
Will GPT-3 tell you when it doesn't have an answer, or does it always fabricate some type of non-empty response? Edit: I just asked "What problem did Luke Skywalker have with tribbles?" Answer: Luke Skywalker had a problem with tribbles because they would constantly try to escape from his lightsaber...
- dreadlordbone 4y ago
  I've never had it tell me it didn't know something, both GPT-3 and ChatGPT variations.
  - criddell 4y ago
    If you ask if for the weather in Paris, it will say it doesn't have that information.
    - lopatin 4y ago
      It's trained to say it doesn't have information to recent data, such as today's weather. But for questions that aren't based on recent data, it should still be able to say "i don't know" or "that question doesn't make sense" in the case of Luke Skywalker's problem with tribbles for example. Edit: I do realize we're criticizing a computer program for not understanding the difference between Star Trek and Star Wars. Strange world we live in.
  - iandinwoodie 4y ago
    I think its a commonly accepted opinion that a person's ability to admit when they don't know something is a strength. It would be interesting to a see how much a constraint for known validity impacts the ability of a model to synthesize responses. In other words, where do we draw the line between knowing and "thinking we know" something (i.e., do we draw the line at 95% confidence)? Surely we do not hold each other to a strict requirement of 100% confidence, but there must be some acceptable range.
    - criddell 4y ago
jgalt212 4y ago
Is this a evil plan to get AWS and Azure to use more electricity than the blockchain?
esamek 4y ago
Not working for me... EDIT: Got it to work. Need a paid account and an API key that was generated after you convert a free trial to a paid account.
deleted 4y ago
[deleted]
bcardarella 4y ago
Do the shortcuts just install on the specific device or will they be available on all devices hooked up to my icloud account? Like my homepod
- kolchinski 4y ago
  Looks like they should be available on other devices too – I just got it to work on my Apple Watch without changing anything. https://support.apple.com/guide/shortcuts-mac/run-shortcuts-with-siri-apd07c25bb38/mac https://support.apple.com/guide/shortcuts-mac/run-shortcuts-...
- _hhkc 4y ago
  They will work on HomePod if you have personal requests enabled on that particular HomePod, which you can do via the Home app.
nomilk 4y ago
Is there somewhere we can view the source code? (the link leads to an 'Add shortcut' button)
- kolchinski 4y ago
  Yep, just click on the three dots over the blue rounded rectangle that says "GPT Mode" and it'll show you!
  - nomilk 4y ago
    Got it, thank you!
twodayslate 4y ago
I've greatly simplified this using Smart AI Actions: https://apps.apple.com/us/app/smart-ai-actions/id1659310170 https://apps.apple.com/us/app/smart-ai-actions/id1659310170

108 points by kolchinski 4y ago

serpix 4y ago

My problem with Siri is that it doesn't understand speech. I am non native speaker but coming from Android I had no problems with Google in understanding what I am saying. It just does not understand or completely alters the phrase.

marcellus23 4y ago
If you're not a native English speaker, have you tried changing the langauge in Settings > Siri & Search? Either to your native language, or to a regional variant of English that more closely matches your accent?
- scarface74 4y ago
  I am learning Spanish and the iOS translate app can’t understand my very bad Spanish. It understands my native language - English - almost perfectly.
anaganisk 4y ago
Unlike Google Assistant, Siri comes from the Apple ecosystem. Apple has a very weak market share in non US countries. Google is where it is because of its huge market share and their ability to capture a lot of data. If Apple is adopted more and more, I dont think Siri will be so bad. They can also train it better with non native accents.

s3p 4y ago

Great work. Just set it up with my API key. Not sure how often I'll be asking siri complex questions, but useful to have either way. Thanks for publishing this on HN!

dsabanin 4y ago

If you change model name in OpenAI request to "text-chat-davinci-002-20230126" and use "<|im_end|>" as a stop, and use this prompt, it will respond like ChatGPT: You are ChatGPT, a large language model trained by OpenAI. You answer as concisely as possible for each response (e.g. don’t be verbose). It is very important that you answer as concisely as possible, so please remember this. If you are generating a list, do not have too many items. Keep the number of items short.

graiz 4y ago
That would be cool, but no. "error": { "message": "That model does not exist", "type": "invalid_request_error", "param": null, "code": null }
- dsabanin 4y ago
  Oh well, it was working pretty well while it lasted.
mritchie712 4y ago
> "text-chat-davinci-002-20230126" https://github.com/acheong08/ChatGPT/issues/523 https://github.com/acheong08/ChatGPT/issues/523

frietzkriesler2 4y ago

Solid work, now we need someone to make a Majel Barret ai voice clone to replace Siri's annoying "I'm a helpful person but not really" voice as well as chapgpts verbosity when asking it certain questions and we will FINALLY have a star trek TNG like computer assistant.

avivo 4y ago

Has anyone gotten this to speak back a response on a Mac? I don't see a setting for this. I'm also curious if there are ways to do this for Google Home and Alexa.

kaliara 4y ago
You can use the "Make spoken audio from" and "play audio file" actions available to Shortcuts. I was able to get it to play from the Mac dock using this method. Screenshot: https://imgur.com/a/EFdyAxF https://imgur.com/a/EFdyAxF

dreadlordbone 4y ago

I've been using my own version of this for a while - it's excellent when you are driving and don't want to have Siri yell at you for asking it something it needs web results for.

criddell 4y ago

Will GPT-3 tell you when it doesn't have an answer, or does it always fabricate some type of non-empty response? Edit: I just asked "What problem did Luke Skywalker have with tribbles?" Answer: Luke Skywalker had a problem with tribbles because they would constantly try to escape from his lightsaber...

dreadlordbone 4y ago
I've never had it tell me it didn't know something, both GPT-3 and ChatGPT variations.
- criddell 4y ago
  If you ask if for the weather in Paris, it will say it doesn't have that information.
  - lopatin 4y ago
    It's trained to say it doesn't have information to recent data, such as today's weather. But for questions that aren't based on recent data, it should still be able to say "i don't know" or "that question doesn't make sense" in the case of Luke Skywalker's problem with tribbles for example. Edit: I do realize we're criticizing a computer program for not understanding the difference between Star Trek and Star Wars. Strange world we live in.
- iandinwoodie 4y ago
  I think its a commonly accepted opinion that a person's ability to admit when they don't know something is a strength. It would be interesting to a see how much a constraint for known validity impacts the ability of a model to synthesize responses. In other words, where do we draw the line between knowing and "thinking we know" something (i.e., do we draw the line at 95% confidence)? Surely we do not hold each other to a strict requirement of 100% confidence, but there must be some acceptable range.
  - criddell 4y ago

jgalt212 4y ago

Is this a evil plan to get AWS and Azure to use more electricity than the blockchain?

esamek 4y ago

Not working for me... EDIT: Got it to work. Need a paid account and an API key that was generated after you convert a free trial to a paid account.

deleted 4y ago

[deleted]

bcardarella 4y ago

Do the shortcuts just install on the specific device or will they be available on all devices hooked up to my icloud account? Like my homepod

kolchinski 4y ago
Looks like they should be available on other devices too – I just got it to work on my Apple Watch without changing anything. https://support.apple.com/guide/shortcuts-mac/run-shortcuts-with-siri-apd07c25bb38/mac https://support.apple.com/guide/shortcuts-mac/run-shortcuts-...
_hhkc 4y ago
They will work on HomePod if you have personal requests enabled on that particular HomePod, which you can do via the Home app.

nomilk 4y ago

Is there somewhere we can view the source code? (the link leads to an 'Add shortcut' button)

kolchinski 4y ago
Yep, just click on the three dots over the blue rounded rectangle that says "GPT Mode" and it'll show you!
- nomilk 4y ago
  Got it, thank you!

twodayslate 4y ago

I've greatly simplified this using Smart AI Actions: https://apps.apple.com/us/app/smart-ai-actions/id1659310170 https://apps.apple.com/us/app/smart-ai-actions/id1659310170