4 ms·

Does elevenlabs have a real-time conversational voice model? It seems like like their focus is largely on text to speech and speech to text. Which can approxima

by sosodev 10mo ago

Does elevenlabs have a real-time conversational voice model? It seems like like their focus is largely on text to speech and speech to text. Which can approximate that type of thing but it's not at all the same as the native voice to voice that 4o does.

dragonwriter 10mo ago
> Does elevenlabs have a real-time conversational voice model? Yes. > It seems like like their focus is largely on text to speech and speech to text. They have two main broad offerings (“Platforms”); you seem to be looking at what they call the “Creative Platform”. The real-time conversational piece is the centerpiece of the “Agents Platform”.
- sosodev 10mo ago
  It specifically says in the architecture docs for the agents platform that it's STT (ASR) -> LLM -> TTS https://elevenlabs.io/docs/agents-platform/overview#architecture https://elevenlabs.io/docs/agents-platform/overview#architec...
- deleted 10mo ago
  [deleted]
hi_im_vijay 10mo ago
[disclaimer, i work at elevenlabs] we specifically went with a cascading model for our agents platform because it's better suited for enterprise use cases where they have full control over the brain and can bring their own llm. with that said, even with a cascading model, we can capture a decent amount of nuance with our asr model, and it also supports capturing audio events like laughter or coughing. a true speech to speech conversational model will perform better on things like capturing tone, pronouncations, phonetics, etc, but i do believe we'll also get better at that on the asr side over time.
- YouAreWRONGtoo 10mo ago
  [dead]