3 ms·
The seamless transition demo is fantastic. The translated voice is passable for my own native voice. It would be incredible when we can achieve this in real-tim
by cebert 2y ago
The seamless transition demo is fantastic. The translated voice is passable for my own native voice. It would be incredible when we can achieve this in real-time.
- exgrv 2y agoWe can! At Kyutai, we released a real-time, on-device speech translation demo last week. For now, it is working only for French to English translation, on an iPhone 16 Pro: https://x.com/neilzegh/status/1887498102455869775 https://x.com/neilzegh/status/1887498102455869775 We released inference code and weights, you can check our github here: https://github.com/kyutai-labs/hibiki https://github.com/kyutai-labs/hibiki
- ketzo 2y agoDamn, this is pretty amazing. Feels like we’re not far off from the babel fish.
- mastermedo 2y agoGood work. The delay seems to be around 5 secods. This is a step in the right direction. I'm wondering how much more real-time can we push it.