4 ms·

For me the last remaining killer feature of ChatGPT is the quality of the voice chat. Do any of the competitors have something like that?

by zug_zug 11mo ago

FrasiertheLion 11mo ago
Try elevenlabs
- sosodev 11mo ago
  Does elevenlabs have a real-time conversational voice model? It seems like like their focus is largely on text to speech and speech to text. Which can approximate that type of thing but it's not at all the same as the native voice to voice that 4o does.
  - dragonwriter 11mo ago
    > Does elevenlabs have a real-time conversational voice model? Yes. > It seems like like their focus is largely on text to speech and speech to text. They have two main broad offerings (“Platforms”); you seem to be looking at what they call the “Creative Platform”. The real-time conversational piece is the centerpiece of the “Agents Platform”.
    - sosodev 11mo ago
      It specifically says in the architecture docs for the agents platform that it's STT (ASR) -> LLM -> TTS https://elevenlabs.io/docs/agents-platform/overview#architecture https://elevenlabs.io/docs/agents-platform/overview#architec...
    - deleted 11mo ago
      [deleted]
  - hi_im_vijay 11mo ago
    [disclaimer, i work at elevenlabs] we specifically went with a cascading model for our agents platform because it's better suited for enterprise use cases where they have full control over the brain and can bring their own llm. with that said, even with a cascading model, we can capture a decent amount of nuance with our asr model, and it also supports capturing audio events like laughter or coughing. a true speech to speech conversational model will perform better on things like capturing tone, pronouncations, phonetics, etc, but i do believe we'll also get better at that on the asr side over time.
    - YouAreWRONGtoo 11mo ago
      [dead]
bigyabai 11mo ago
Qwen does.
- sosodev 11mo ago
  Qwen's voice chat is nowhere near as good as ChatGPT's.
Robdel12 11mo ago
I have found Claude‘s voice chat to be better. I only recently tried it because I liked ChatGPTs enough, but I think I’m going to use Claude going forward. I find myself getting interrupted by ChatGPT a lot whenever I do use it.
- lxgr 11mo ago
  Claude’s voice chat isn’t “native” though, is it? It feels like it’s speech-to-text-to-LLM and back.
  - sosodev 11mo ago
    You can test it by asking it to: change the pitch of its voice, make specific sounds (like laughter), differentiate between words that are spelled the same but pronounced differently (record and record), etc.
    - lxgr 11mo ago
      Good idea, but an external “bolted on” LLM-based TTS would still pass that in many cases, right?
      - barrkel 11mo ago
        The model giving it text to speak would have to annotate the text in order for the TTS to add the affect. The TTS wouldn't "remember" such instructions from a speech to text stage previously.
      - sosodev 11mo ago
        Yes, a sufficiently advanced marrying of TTS and LLM could pass a lot of these tests. That kind of blurs the line between native voice model and not though. You would need: * A STT (ASR) model that outputs phonetics not just words * An LLM fine-tuned to understand that and also output the proper tokens for prosody control, non-speech vocalizations, etc * A TTS model that understands those tokens and properly generate the matching voice At that point I would probably argue that you've created a native voice model even if it's still less nuanced than the proper voice to voice of something like 4o. The latency would likely be quite high though. I'm pretty sure I've seen a couple of open source projects that have done this type of setup but I've not tried testing them.
codybontecou 11mo ago
Their voice agent is handy. Currently trying to build around it.
websiteapi 11mo ago
gemini live is a thing - never tried chaptgpt, are they not similar?
- jeanlucas 11mo ago
  no.
  - leaK_u 11mo ago
    how.
    - CamelCaseName 11mo ago
      I find ChatGPT's voice to text to be the absolute best in the world, nearly perfect. I have constant frustrations with Gemini voice to text misunderstanding what I'm saying or worse, immediately sending my voice note when I pause or breathe even though I'm midway through a sentence.
  - nickvec 11mo ago
    What? The voice chat is basically identical on ChatGPT and Gemini AFAICT.
- spudlyo 11mo ago
  Not for my use case. I can open it up, and in restored classical Latin pronunciation say "Hi, my name is X, how are you?" and it will respond (also in Latin) "Hello X, I am well, thanks for asking. I hope you are doing great." Its pronunciation is not great, but intelligible. In the written transcript, it butchers what I say, but its responses look good, although sans macrons indicating phonemic vowel length. Gemini responds in what I think is Spanish, or perhaps Portuguese. However I can hand an 8 minute long 48k mono mp3 of a nuanced Latin speaker who nasalizes his vowels, and makes regular use of elision to Gemini-3-pro-preview and it will produce an accurate macronized Latin transcription. It's pretty mind blowing.
  - Dilettante_ 11mo ago
tmaly 11mo ago
I can't keep up with half the new features all the model companies keep rolling out. I wish they would solve that
sundarurfriend 11mo ago
Are you saying ChatGPT's voice chat is of good quality? Because for me it's one of its most frustrating weaknesses. I vastly prefer voice input to typing, and would love it if the voice chat mode actually worked well. But apart from the voices being pretty meh, it's also really bad at detecting and filtering out noise, taking vehicle sounds as breaks to start talking in (even if I'm talking much louder at the same time) or as some random YouTube subtitles (car motor = "Thanks for watching, subscribe!"). The speech-to-text is really unreliable (the single-chat Dictate feature gets about 98% of my words correct, this Voice mode is closer to 75%), and they clearly use an inferior model for the AI backend for this too: with the same question asked in this back-and-forth Voice mode and a normal text chat, the answer quality difference is quite stark: the Voice mode answer is most often close to useless. It seems like they've overoptimized it for speed at the cost of quality, to the extent that it feels like it's a year behind in answer reliability and usefulness. To your question about competitors, I've recently noticed that Grok seems to be much better at both the speech-to-text part and the noise handling, and the voices are less uncanny-valley sounding too. I'd say they also don't have that stark a difference between text answers and voice mode answers, and that would be true but unfortunately mainly because its text answers are also not great with hallucinations or following instructions. So Grok has the voice part figured out, ChatGPT has the backend AI reliability figured out, but neither provide a real usable voice mode right now.
semiinfinitely 11mo ago
try gemini voice chat
ivape 11mo ago
I'm a big user of Gemini voice. My sense is that Gemini voice uses very tight system prompts that are designed to give you an answer and kind of get you off the phone as much as possible. It doesn't have large context at all. That's how I judge quality at least. The quality of the actual voice is roughly the same as ChatGPT, but I notice Gemini will try to match your pitch and tone and way of speaking. Edit: But it looks like Gemini Voice has been replaced with voice transcription in the mobile app? That was sudden.
whimsicalism 11mo ago
gemini does, grok does, nobody else does (except alibaba but it’s not there yet)
joshmarlow 11mo ago
I think Grok's voice chat is almost there - only things missing for me: * it's slower to start-up by a couple of seconds * it's harder to switch between voice and text and back again in the same chat (though ChatGPT isn't perfect at this either) And of course Grok's unhinged persona is... something else.
- nazgulsenpai 11mo ago
  It's so much fun. So is the Conspiracy persona.
- jesse_dot_id 11mo ago
  [flagged]
- Gigachad 11mo ago
  Pretty good until it goes crazy glazing Elon or declaring itself mecha hitler.
  - hcurtiss 11mo ago
    Neither of these have happened in my use. Those were both the product of some pretty aggressive prompting, and were remedied months ago.
    - OrangeMusic 11mo ago
      Yet, using this model in any way whatsoever after these episodes seems absolutely crazy to me.
      - user34283 11mo ago
        Grok is the only frontier model that is at all usable for adult content.
      - hcurtiss 11mo ago
        All models have had similar instances. I particularly enjoyed Gemini’s black founders era. The “safety” teams have bent the politics of these tools in ways I don’t trust. Grok does too, but in my experience less so. This has real impacts.
hbarka 11mo ago
On the contrary, I thought Gemini 3 Live mode is much much better than ChatGPT. The voices have none of the annoying artificial uptalking intonations that ChatGPT has, and the simplex/duplex interruptibility of Gemini Live seems more responsive. It knows when to break and pause during conversations.
- febed 11mo ago
  Apart from sounding a bit stiff and informal, I was also surprised at how good Gemini Live mode is in regional Indian languages.
simondotau 11mo ago
I absolutely loathe ChatGPT's voice chat. It spends far too much time being conversational and its eagerness to please becomes fatiguing after the first back-and-forth.
josephwegner 11mo ago
Along with the hordes of other options people are responding with, I'm a big fan of Perplexity's voice chat. It does back-and-forth well in a way that I missed whenever I tried anything besides ChatGPT.
- solarkraft 11mo ago
  It is, shockingly, based on the OpenAI Realtime Assistant API.
SweetSoftPillow 11mo ago
Gemini's much better, try it

For me the last remaining killer feature of ChatGPT is the quality of the voice chat. Do any of the competitors have something like that?

by zug_zug 11mo ago

For me the last remaining killer feature of ChatGPT is the quality of the voice chat. Do any of the competitors have something like that?

FrasiertheLion 11mo ago

Try elevenlabs

sosodev 11mo ago
Does elevenlabs have a real-time conversational voice model? It seems like like their focus is largely on text to speech and speech to text. Which can approximate that type of thing but it's not at all the same as the native voice to voice that 4o does.
- dragonwriter 11mo ago
  > Does elevenlabs have a real-time conversational voice model? Yes. > It seems like like their focus is largely on text to speech and speech to text. They have two main broad offerings (“Platforms”); you seem to be looking at what they call the “Creative Platform”. The real-time conversational piece is the centerpiece of the “Agents Platform”.
  - sosodev 11mo ago
    It specifically says in the architecture docs for the agents platform that it's STT (ASR) -> LLM -> TTS https://elevenlabs.io/docs/agents-platform/overview#architecture https://elevenlabs.io/docs/agents-platform/overview#architec...
  - deleted 11mo ago
    [deleted]
- hi_im_vijay 11mo ago
  [disclaimer, i work at elevenlabs] we specifically went with a cascading model for our agents platform because it's better suited for enterprise use cases where they have full control over the brain and can bring their own llm. with that said, even with a cascading model, we can capture a decent amount of nuance with our asr model, and it also supports capturing audio events like laughter or coughing. a true speech to speech conversational model will perform better on things like capturing tone, pronouncations, phonetics, etc, but i do believe we'll also get better at that on the asr side over time.
  - YouAreWRONGtoo 11mo ago
    [dead]

bigyabai 11mo ago

Qwen does.

sosodev 11mo ago
Qwen's voice chat is nowhere near as good as ChatGPT's.

Robdel12 11mo ago

I have found Claude‘s voice chat to be better. I only recently tried it because I liked ChatGPTs enough, but I think I’m going to use Claude going forward. I find myself getting interrupted by ChatGPT a lot whenever I do use it.

lxgr 11mo ago
Claude’s voice chat isn’t “native” though, is it? It feels like it’s speech-to-text-to-LLM and back.
- sosodev 11mo ago
  You can test it by asking it to: change the pitch of its voice, make specific sounds (like laughter), differentiate between words that are spelled the same but pronounced differently (record and record), etc.
  - lxgr 11mo ago
    Good idea, but an external “bolted on” LLM-based TTS would still pass that in many cases, right?
    - barrkel 11mo ago
      The model giving it text to speak would have to annotate the text in order for the TTS to add the affect. The TTS wouldn't "remember" such instructions from a speech to text stage previously.
    - sosodev 11mo ago
      Yes, a sufficiently advanced marrying of TTS and LLM could pass a lot of these tests. That kind of blurs the line between native voice model and not though. You would need: * A STT (ASR) model that outputs phonetics not just words * An LLM fine-tuned to understand that and also output the proper tokens for prosody control, non-speech vocalizations, etc * A TTS model that understands those tokens and properly generate the matching voice At that point I would probably argue that you've created a native voice model even if it's still less nuanced than the proper voice to voice of something like 4o. The latency would likely be quite high though. I'm pretty sure I've seen a couple of open source projects that have done this type of setup but I've not tried testing them.

codybontecou 11mo ago

Their voice agent is handy. Currently trying to build around it.

websiteapi 11mo ago

gemini live is a thing - never tried chaptgpt, are they not similar?

jeanlucas 11mo ago
no.
- leaK_u 11mo ago
  how.
  - CamelCaseName 11mo ago
    I find ChatGPT's voice to text to be the absolute best in the world, nearly perfect. I have constant frustrations with Gemini voice to text misunderstanding what I'm saying or worse, immediately sending my voice note when I pause or breathe even though I'm midway through a sentence.
- nickvec 11mo ago
  What? The voice chat is basically identical on ChatGPT and Gemini AFAICT.
spudlyo 11mo ago
Not for my use case. I can open it up, and in restored classical Latin pronunciation say "Hi, my name is X, how are you?" and it will respond (also in Latin) "Hello X, I am well, thanks for asking. I hope you are doing great." Its pronunciation is not great, but intelligible. In the written transcript, it butchers what I say, but its responses look good, although sans macrons indicating phonemic vowel length. Gemini responds in what I think is Spanish, or perhaps Portuguese. However I can hand an 8 minute long 48k mono mp3 of a nuanced Latin speaker who nasalizes his vowels, and makes regular use of elision to Gemini-3-pro-preview and it will produce an accurate macronized Latin transcription. It's pretty mind blowing.
- Dilettante_ 11mo ago

tmaly 11mo ago

I can't keep up with half the new features all the model companies keep rolling out. I wish they would solve that

sundarurfriend 11mo ago

Are you saying ChatGPT's voice chat is of good quality? Because for me it's one of its most frustrating weaknesses. I vastly prefer voice input to typing, and would love it if the voice chat mode actually worked well. But apart from the voices being pretty meh, it's also really bad at detecting and filtering out noise, taking vehicle sounds as breaks to start talking in (even if I'm talking much louder at the same time) or as some random YouTube subtitles (car motor = "Thanks for watching, subscribe!"). The speech-to-text is really unreliable (the single-chat Dictate feature gets about 98% of my words correct, this Voice mode is closer to 75%), and they clearly use an inferior model for the AI backend for this too: with the same question asked in this back-and-forth Voice mode and a normal text chat, the answer quality difference is quite stark: the Voice mode answer is most often close to useless. It seems like they've overoptimized it for speed at the cost of quality, to the extent that it feels like it's a year behind in answer reliability and usefulness. To your question about competitors, I've recently noticed that Grok seems to be much better at both the speech-to-text part and the noise handling, and the voices are less uncanny-valley sounding too. I'd say they also don't have that stark a difference between text answers and voice mode answers, and that would be true but unfortunately mainly because its text answers are also not great with hallucinations or following instructions. So Grok has the voice part figured out, ChatGPT has the backend AI reliability figured out, but neither provide a real usable voice mode right now.

semiinfinitely 11mo ago

try gemini voice chat

ivape 11mo ago

I'm a big user of Gemini voice. My sense is that Gemini voice uses very tight system prompts that are designed to give you an answer and kind of get you off the phone as much as possible. It doesn't have large context at all. That's how I judge quality at least. The quality of the actual voice is roughly the same as ChatGPT, but I notice Gemini will try to match your pitch and tone and way of speaking. Edit: But it looks like Gemini Voice has been replaced with voice transcription in the mobile app? That was sudden.

whimsicalism 11mo ago

gemini does, grok does, nobody else does (except alibaba but it’s not there yet)

joshmarlow 11mo ago

I think Grok's voice chat is almost there - only things missing for me: * it's slower to start-up by a couple of seconds * it's harder to switch between voice and text and back again in the same chat (though ChatGPT isn't perfect at this either) And of course Grok's unhinged persona is... something else.

nazgulsenpai 11mo ago
It's so much fun. So is the Conspiracy persona.
jesse_dot_id 11mo ago
[flagged]
Gigachad 11mo ago
Pretty good until it goes crazy glazing Elon or declaring itself mecha hitler.
- hcurtiss 11mo ago
  Neither of these have happened in my use. Those were both the product of some pretty aggressive prompting, and were remedied months ago.
  - OrangeMusic 11mo ago
    Yet, using this model in any way whatsoever after these episodes seems absolutely crazy to me.
    - user34283 11mo ago
      Grok is the only frontier model that is at all usable for adult content.
    - hcurtiss 11mo ago
      All models have had similar instances. I particularly enjoyed Gemini’s black founders era. The “safety” teams have bent the politics of these tools in ways I don’t trust. Grok does too, but in my experience less so. This has real impacts.

hbarka 11mo ago

On the contrary, I thought Gemini 3 Live mode is much much better than ChatGPT. The voices have none of the annoying artificial uptalking intonations that ChatGPT has, and the simplex/duplex interruptibility of Gemini Live seems more responsive. It knows when to break and pause during conversations.

febed 11mo ago
Apart from sounding a bit stiff and informal, I was also surprised at how good Gemini Live mode is in regional Indian languages.

simondotau 11mo ago

I absolutely loathe ChatGPT's voice chat. It spends far too much time being conversational and its eagerness to please becomes fatiguing after the first back-and-forth.

josephwegner 11mo ago

Along with the hordes of other options people are responding with, I'm a big fan of Perplexity's voice chat. It does back-and-forth well in a way that I missed whenever I tried anything besides ChatGPT.

solarkraft 11mo ago
It is, shockingly, based on the OpenAI Realtime Assistant API.

SweetSoftPillow 11mo ago

Gemini's much better, try it