4 ms·

It’s insanely fast. Here’s an AI voice assistant I built that uses it: https://cerebras.vercel.app https://cerebras.vercel.app

by russ 2y ago

bilater 2y ago
Nice! What are the other pieces of the stack you'r using?
- bcherry 2y ago
  LiveKit, Cartesia, Deepgram, and Vercel
  - bilater 2y ago
    awesome - might try it out
deleted 2y ago
[deleted]
wenc 2y ago
This is pretty amazing. It's fast enough to converse with, and I can interrupt the model. The underlying model is not voice trained -- she says things like "asterisk one" (reading out point form) -- but this is a great preview for when ChatGPT GAs their Voice Mode.
unraveller 2y ago
Fantastic demo. Do you know what's the difference between your stack and the livekit demo? [1] it shows your voice as text so you can see when you have to correct it. Llama3 with ears just dropped (direct voice token input) which should be awesome with cerebras [2] [1]: https://kitt.livekit.io https://kitt.livekit.io [2]: https://homebrew.ltd/blog/llama3-just-got-ears https://homebrew.ltd/blog/llama3-just-got-ears
joshhug 2y ago
That was interesting. I asked it to try to say something in another language, and she read it in a thick American accent. No surprise. Then I asked her to sing, and she said something like "asterisk in a robotic singing voice asterisk...", and then later explained that she's just text to speech. Ah, ok, that's about what I expected. But then I asked her to integrate sin(x) * e^x and got this bizarre answer that started out as speech sounds but then degenerated into chaos. Out of curiosity, why and how did she end up generating samples that sounded rather unlike speech? Here's a recording: https://youtu.be/wWhxF7ybiAc https://youtu.be/wWhxF7ybiAc FWIW, I can get this behavior pretty consistently if I chat with her a while about her voice capabilities and then go into a math question.
innagadadavida 2y ago
Oh wow, this is insanely good. Are there any model details?

It’s insanely fast. Here’s an AI voice assistant I built that uses it: https://cerebras.vercel.app https://cerebras.vercel.app

by russ 2y ago

It’s insanely fast. Here’s an AI voice assistant I built that uses it: https://cerebras.vercel.app https://cerebras.vercel.app

bilater 2y ago

Nice! What are the other pieces of the stack you'r using?

bcherry 2y ago
LiveKit, Cartesia, Deepgram, and Vercel
- bilater 2y ago
  awesome - might try it out

deleted 2y ago

[deleted]

wenc 2y ago

This is pretty amazing. It's fast enough to converse with, and I can interrupt the model. The underlying model is not voice trained -- she says things like "asterisk one" (reading out point form) -- but this is a great preview for when ChatGPT GAs their Voice Mode.

unraveller 2y ago

Fantastic demo. Do you know what's the difference between your stack and the livekit demo? [1] it shows your voice as text so you can see when you have to correct it. Llama3 with ears just dropped (direct voice token input) which should be awesome with cerebras [2] [1]: https://kitt.livekit.io https://kitt.livekit.io [2]: https://homebrew.ltd/blog/llama3-just-got-ears https://homebrew.ltd/blog/llama3-just-got-ears

joshhug 2y ago

That was interesting. I asked it to try to say something in another language, and she read it in a thick American accent. No surprise. Then I asked her to sing, and she said something like "asterisk in a robotic singing voice asterisk...", and then later explained that she's just text to speech. Ah, ok, that's about what I expected. But then I asked her to integrate sin(x) * e^x and got this bizarre answer that started out as speech sounds but then degenerated into chaos. Out of curiosity, why and how did she end up generating samples that sounded rather unlike speech? Here's a recording: https://youtu.be/wWhxF7ybiAc https://youtu.be/wWhxF7ybiAc FWIW, I can get this behavior pretty consistently if I chat with her a while about her voice capabilities and then go into a math question.

innagadadavida 2y ago

Oh wow, this is insanely good. Are there any model details?