3 ms·

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a

by xenova 2y ago

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!

deivid 2y ago
Amazing! I'm interested in models running locally and Kokoro seems amazing. Are you aware of similar models but for Speech to text?
- Ono-Sendai 2y ago
  whisper
- xenova 2y ago
  We have released a bunch of speech recognition demos (using whisper, moonshine, and others). For example: - https://huggingface.co/spaces/Xenova/whisper-web https://huggingface.co/spaces/Xenova/whisper-web - https://huggingface.co/spaces/Xenova/whisper-webgpu https://huggingface.co/spaces/Xenova/whisper-webgpu - https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu - https://huggingface.co/spaces/webml-community/moonshine-web https://huggingface.co/spaces/webml-community/moonshine-web
  - alex_young 2y ago
    The realtime Whisper demo is amazing. How can I understand what's in the compiled JS though? Is there some source for that?
amelius 2y ago
Now that's what I call "server-less" computing!
sebastiennight 2y ago
This is brilliant. All we need now is for someone to code a frontend for it so we can input an article's URL and have this voice read it out loud... built-in local voices on MacOS are not even close to this Kokoro model
- satvikpendem 2y ago
  There are a few already, I assume MacWhisper will add it. That being said, I am also working on a (crossplatform, in Flutter) UI for this.
  - sebastiennight 2y ago
    My understanding is that MacWhisper is a front-end for Whisper.cpp so... it does Speech-to-text? (transcribing what you dictate) Here I'm talking about the model shared in this thread, which is text-to-speech (reading out loud content from the web)
    - satvikpendem 2y ago
      Yes, I am saying they might include features for TTS in addition to their current STT feature set. Seems like many of these sorts of apps are looking to add both to be more full fledged.

by xenova 2y ago

deivid 2y ago

Amazing! I'm interested in models running locally and Kokoro seems amazing. Are you aware of similar models but for Speech to text?

Ono-Sendai 2y ago
whisper
xenova 2y ago
We have released a bunch of speech recognition demos (using whisper, moonshine, and others). For example: - https://huggingface.co/spaces/Xenova/whisper-web https://huggingface.co/spaces/Xenova/whisper-web - https://huggingface.co/spaces/Xenova/whisper-webgpu https://huggingface.co/spaces/Xenova/whisper-webgpu - https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu - https://huggingface.co/spaces/webml-community/moonshine-web https://huggingface.co/spaces/webml-community/moonshine-web
- alex_young 2y ago
  The realtime Whisper demo is amazing. How can I understand what's in the compiled JS though? Is there some source for that?

amelius 2y ago

Now that's what I call "server-less" computing!

sebastiennight 2y ago

This is brilliant. All we need now is for someone to code a frontend for it so we can input an article's URL and have this voice read it out loud... built-in local voices on MacOS are not even close to this Kokoro model

satvikpendem 2y ago
There are a few already, I assume MacWhisper will add it. That being said, I am also working on a (crossplatform, in Flutter) UI for this.
- sebastiennight 2y ago
  My understanding is that MacWhisper is a front-end for Whisper.cpp so... it does Speech-to-text? (transcribing what you dictate) Here I'm talking about the model shared in this thread, which is text-to-speech (reading out loud content from the web)
  - satvikpendem 2y ago
    Yes, I am saying they might include features for TTS in addition to their current STT feature set. Seems like many of these sorts of apps are looking to add both to be more full fledged.