4 ms·

Show HN: KaniTTS – Open-source high-fidelity TTS with just 450M params

5 points by ulan_kg 1y ago

ulan_kg 1y ago
Hey HN, We've been tinkering with TTS models for a while, and I'm excited to share KaniTTS – an open-source text-to-speech system we built at NineNineSix.ai. It's designed for speed and quality, hitting real-time generation on consumer GPUs while sounding natural and expressive. Quick overview: Architecture: Two-stage pipeline – a LiquidAI LFM2-350M backbone generates compact semantic/acoustic tokens from text (handling prosody, punctuation, etc.), then NVIDIA's NanoCodec synthesizes them into 22kHz waveforms. Trained on ~50k hours of data. Performance: On an RTX 5080, it generates 15s of audio in ~1s with only 2GB VRAM. Languages: English-focused, but tokenizer supports Arabic, Chinese, French, German, Japanese, Korean, Spanish (fine-tune for better non-English prosody). Use cases: Conversational AI, edge devices, accessibility, or research. Batch up to 16 texts for high throughput. It's Apache 2.0 licensed, so fork away. Check the audio comparisons on the page – it holds up well against ElevenLabs or Cartesia. Repo: https://github.com/nineninesix-ai/kani-tts https://github.com/nineninesix-ai/kani-tts Model: https://huggingface.co/nineninesix/kani-tts-450m-0.1-pt https://huggingface.co/nineninesix/kani-tts-450m-0.1-pt Page: https://www.nineninesix.ai/n/kani-tts https://www.nineninesix.ai/n/kani-tts Feedback welcome – what's your go-to TTS setup?
- homarp 1y ago
  can you add kokoro tts output next to yours? and a few others Apache 2 TTS of your choice
  - ulan_kg 1y ago
    ya, you can check out our post https://www.nineninesix.ai/n/kani-tts https://www.nineninesix.ai/n/kani-tts . I've taken a bunch of OSS and closed TTS outputs there
gangtao 1y ago
there are lots of TTS models, while what I care most is how can I easily use it, like clone my voice?
- ulan_kg 1y ago
  most TTS models are either small and too robotic or big and slow. We try to hit the sweet spot: near-human quality (MOS 4.3/5) while running fast on consumer GPUs like an RTX 5080. For voice cloning, it's better to fine-tune the base model, if you are chasing top quality. What’s your use case?

5 points by ulan_kg 1y ago

Hey HN, We've been tinkering with TTS models for a while, and I'm excited to share KaniTTS – an open-source text-to-speech system we built at NineNineSix.ai. It's designed for speed and quality, hitting real-time generation on consumer GPUs while sounding natural and expressive. Quick overview: Architecture: Two-stage pipeline – a LiquidAI LFM2-350M backbone generates compact semantic/acoustic tokens from text (handling prosody, punctuation, etc.), then NVIDIA's NanoCodec synthesizes them into 22kHz waveforms. Trained on ~50k hours of data. Performance: On an RTX 5080, it generates 15s of audio in ~1s with only 2GB VRAM. Languages: English-focused, but tokenizer supports Arabic, Chinese, French, German, Japanese, Korean, Spanish (fine-tune for better non-English prosody). Use cases: Conversational AI, edge devices, accessibility, or research. Batch up to 16 texts for high throughput. It's Apache 2.0 licensed, so fork away. Check the audio comparisons on the page – it holds up well against ElevenLabs or Cartesia. Repo: https://github.com/nineninesix-ai/kani-tts https://github.com/nineninesix-ai/kani-tts Model: https://huggingface.co/nineninesix/kani-tts-450m-0.1-pt https://huggingface.co/nineninesix/kani-tts-450m-0.1-pt Page: https://www.nineninesix.ai/n/kani-tts https://www.nineninesix.ai/n/kani-tts Feedback welcome – what's your go-to TTS setup?

homarp 1y ago
can you add kokoro tts output next to yours? and a few others Apache 2 TTS of your choice
- ulan_kg 1y ago
  ya, you can check out our post https://www.nineninesix.ai/n/kani-tts https://www.nineninesix.ai/n/kani-tts . I've taken a bunch of OSS and closed TTS outputs there

gangtao 1y ago

there are lots of TTS models, while what I care most is how can I easily use it, like clone my voice?

ulan_kg 1y ago
most TTS models are either small and too robotic or big and slow. We try to hit the sweet spot: near-human quality (MOS 4.3/5) while running fast on consumer GPUs like an RTX 5080. For voice cloning, it's better to fine-tune the base model, if you are chasing top quality. What’s your use case?