3 ms·

Not sure if I understood that right -- is that something like Whisper + an LLM? Like [0]? If OpenAI adds speech input to ChatGPT -- and considering the upcomin

by 19h 4y ago

Not sure if I understood that right -- is that something like Whisper + an LLM? Like [0]? If OpenAI adds speech input to ChatGPT -- and considering the upcoming plugins -- isn't a possible enterprise specialisation of VoCode the only viable long term investment? [0] https://twitter.com/ggerganov/status/1640022482307502085 https://twitter.com/ggerganov/status/1640022482307502085

KianHooshmand 4y ago
Our belief is that at some point OpenAI will add a speech-to-speech model. This will improve the library functionality (since now the whole stack is controlled by a single entity, so the product will naturally be better latency/quality wise). Our library is open source so that we can all build a development/utility layer on top of whatever foundational models are created. Plugins of course also improve what the agents can do. And right, we will be building enterprise focused products in the future!
- ttul 4y ago
  OpenAI will absolutely add voice and my guess is that their voice support will rival anything on the market because they will train the voice model alongside the text and image models. This is likely months away if not weeks away. Obviously just my $0.02: I'd start building for the enterprise right now. Visualize a future where there are several multimodal AGIs that work with voice, images, and text. Be the enterprise voice layer for all of them. Build your moat there.
  - KianHooshmand 4y ago
    We totally agree – thank you for the feedback! :)
  - sebzim4500 4y ago
    I don't think there will be any demand for a self-hosted voice model with a SaaS LLM though. So that only works if they are going to train an LLM from scratch (or take the legal risk of using LLaMA).
KianHooshmand 4y ago
And yes! It's STT/LLM/TTS where you can choose between different providers and run it across different platforms. It can be turn based (like the demo you linked from twitter) or streaming (this allows for conversation with interruptions!)
- pbronez 4y ago
  Another big win here would be multi-lingual support.

by 19h 4y ago

KianHooshmand 4y ago

Our belief is that at some point OpenAI will add a speech-to-speech model. This will improve the library functionality (since now the whole stack is controlled by a single entity, so the product will naturally be better latency/quality wise). Our library is open source so that we can all build a development/utility layer on top of whatever foundational models are created. Plugins of course also improve what the agents can do. And right, we will be building enterprise focused products in the future!

ttul 4y ago
OpenAI will absolutely add voice and my guess is that their voice support will rival anything on the market because they will train the voice model alongside the text and image models. This is likely months away if not weeks away. Obviously just my $0.02: I'd start building for the enterprise right now. Visualize a future where there are several multimodal AGIs that work with voice, images, and text. Be the enterprise voice layer for all of them. Build your moat there.
- KianHooshmand 4y ago
  We totally agree – thank you for the feedback! :)
- sebzim4500 4y ago
  I don't think there will be any demand for a self-hosted voice model with a SaaS LLM though. So that only works if they are going to train an LLM from scratch (or take the legal risk of using LLaMA).

KianHooshmand 4y ago

And yes! It's STT/LLM/TTS where you can choose between different providers and run it across different platforms. It can be turn based (like the demo you linked from twitter) or streaming (this allows for conversation with interruptions!)

pbronez 4y ago
Another big win here would be multi-lingual support.