from Hacker News

Show HN: Realtime Video Calls with ChatGPT

by jakedahn on 4/26/23, 6:12 PM with 9 comments

Hi everyone, I've been working with a few friends on this app that lets you do real-time video chats with your new best AI friend named Annie.

We just released the first version for iOS, you can find the download link on https://callannie.ai

You can find a video demo here: https://www.youtube.com/watch?v=8MV2mjjQFSU

Annie can help as a tutor on any topic, chat about your day, or help you practice any conversation. She can also check the weather and perform basic web searches.

The original image of Annie's face was generated with Midjourney, and her expressions and lip movements are animated on-device in real-time to match the generated speech. Right now, the content of what she says is generated by ChatGPT.

If Annie's answers are too long, you can interrupt her. If you need her to pause so you can think, say "hold on." You can say “can you search the web” to trigger web search mode (this is also available in the conversation menu).

Hope you enjoy speaking with Annie! Let us know what you think in the comments

  • by notlisted on 4/27/23, 4:22 PM

    I'm surprised this doesn't get more traction on HN. The implementation is much more responsive than I'd anticipated.

    Are the answers GPT3.5?

    For your entertainment, ask a question in another language, it will actually understand and respond in said language, but pronounces every word as a native English speaker (e.g. Parlez-vous français ou italien)

  • by yboris on 4/27/23, 2:11 PM

    Just tried on my iPad - amazing product! For some reason no face shows up, just black background (but voice works amazingly well).

    Direct App Store link: https://apps.apple.com/us/app/call-annie/id6447928709

  • by dr_j_ on 4/28/23, 2:39 PM

    This is fantastic. Great work. Works well on my iPad but no ‘face’ just a blank screen. Crashes on my M1 Mac Air. Let me know if there’s anything I can do to help debug.

  • by ron6 on 4/28/23, 1:13 PM

    I just tried it. It is surprisingly good, especially the accuracy of the speech to text, is it based on openAI's model Whisper?

  • by vimy on 4/29/23, 2:50 PM

    Looks really nice. How did you animate the face?

  • by aero-glide2 on 4/27/23, 2:40 AM

    Quite impressive, useful when I'm thinking out loud.