5 ms·

Show HN: Realtime Video Calls with ChatGPT

20 points by jakedahn 3y ago

Hi everyone, I've been working with a few friends on this app that lets you do real-time video chats with your new best AI friend named Annie. We just released the first version for iOS, you can find the download link on https://callannie.ai https://callannie.ai You can find a video demo here: https://www.youtube.com/watch?v=8MV2mjjQFSU https://www.youtube.com/watch?v=8MV2mjjQFSU Annie can help as a tutor on any topic, chat about your day, or help you practice any conversation. She can also check the weather and perform basic web searches. The original image of Annie's face was generated with Midjourney, and her expressions and lip movements are animated on-device in real-time to match the generated speech. Right now, the content of what she says is generated by ChatGPT. If Annie's answers are too long, you can interrupt her. If you need her to pause so you can think, say "hold on." You can say “can you search the web” to trigger web search mode (this is also available in the conversation menu). Hope you enjoy speaking with Annie! Let us know what you think in the comments

ron6 3y ago
I just tried it. It is surprisingly good, especially the accuracy of the speech to text, is it based on openAI's model Whisper?
dr_j_ 3y ago
This is fantastic. Great work. Works well on my iPad but no ‘face’ just a blank screen. Crashes on my M1 Mac Air. Let me know if there’s anything I can do to help debug.
vimy 3y ago
Looks really nice. How did you animate the face?
aero-glide2 3y ago
Quite impressive, useful when I'm thinking out loud.
- redsh 3y ago
  nice! thanks. do you prefer the face video mode, or just audio for that?
yboris 3y ago
Just tried on my iPad - amazing product! For some reason no face shows up, just black background (but voice works amazingly well). Direct App Store link: https://apps.apple.com/us/app/call-annie/id6447928709 https://apps.apple.com/us/app/call-annie/id6447928709
- redsh 3y ago
  ipad model? We have requirement on the apple chip generation of the iphone 12
notlisted 3y ago
I'm surprised this doesn't get more traction on HN. The implementation is much more responsive than I'd anticipated. Are the answers GPT3.5? For your entertainment, ask a question in another language, it will actually understand and respond in said language, but pronounces every word as a native English speaker (e.g. Parlez-vous français ou italien)
- redsh 3y ago
  yes, it's based on gpt3.5.. thanks!

20 points by jakedahn 3y ago

ron6 3y ago

I just tried it. It is surprisingly good, especially the accuracy of the speech to text, is it based on openAI's model Whisper?

dr_j_ 3y ago

This is fantastic. Great work. Works well on my iPad but no ‘face’ just a blank screen. Crashes on my M1 Mac Air. Let me know if there’s anything I can do to help debug.

vimy 3y ago

Looks really nice. How did you animate the face?

aero-glide2 3y ago

Quite impressive, useful when I'm thinking out loud.

redsh 3y ago
nice! thanks. do you prefer the face video mode, or just audio for that?

yboris 3y ago

Just tried on my iPad - amazing product! For some reason no face shows up, just black background (but voice works amazingly well). Direct App Store link: https://apps.apple.com/us/app/call-annie/id6447928709 https://apps.apple.com/us/app/call-annie/id6447928709

redsh 3y ago
ipad model? We have requirement on the apple chip generation of the iphone 12

notlisted 3y ago

I'm surprised this doesn't get more traction on HN. The implementation is much more responsive than I'd anticipated. Are the answers GPT3.5? For your entertainment, ask a question in another language, it will actually understand and respond in said language, but pronounces every word as a native English speaker (e.g. Parlez-vous français ou italien)

redsh 3y ago
yes, it's based on gpt3.5.. thanks!