5 ms·
Inflect-Micro-v2: complete voice in 9.36M parameters
- tmaly 3mo agoThis is impressive. I wish there were a voice clone option.
- fastball 3mo agoWith so few parameters, I imagine a voice fine-tune might be readily tractable.
- deleted 3mo ago[deleted]
- jsomedon 3mo agoamazing quality for such small size!
- yjftsjthsd-h 3mo agoCouple highlights: > Complete local text-to-waveform speech synthesis under 10M parameters. In case, like me, you hoped "complete" voice might mean both stt and tts. Not to speak poorly of it, just clarifying. > English only, with one fixed male voice. This is not zero-shot voice cloning. (And then a bunch of statements on limitations that I read as 'quality can be spotty but if you play with it it should be fine') But like. In <10M params I'm not judging:)
- semiquaver 3mo agoWhen would “text-to-waveform speech synthesis” ever imply speech to text?
- yjftsjthsd-h 3mo agoThe HN title is "Inflect-Micro-v2: complete voice in 9.36M parameters".
- modinfo 3mo agoThis is amazing, the quality blow my mind for such small model! I just replaced my old onnx model with yours! here my implementation with speech dispatcher and server: https://github.com/skorotkiewicz/inflect-speechd https://github.com/skorotkiewicz/inflect-speechd thanks for shearing!
- itake 3mo agoAmazing quality for small size, but definitely not that enjoyable to listen to. IMHO, its at about the same quality level of historic TTS tools.
- NetOpWibby 3mo agoThe inflections are weird but this doesn't sound like a robot. Not bad!
- StilesCrisis 3mo agoI'd love to hear it but it seems your quota is exhausted.
- g58892881 3mo agowrote a web-demo, runs in your browser https://inflect-tts.geronimo-labs.com https://inflect-tts.geronimo-labs.com code: https://github.com/geronimi73/inflect-tts https://github.com/geronimi73/inflect-tts
- StilesCrisis 3mo agoNice! Strangely, "Nano" sounds a lot better than "Micro" to me. On my iPhone 14 Pro the page crashes after 2-3 plays. I wonder if it uses too much memory?
- g58892881 3mo agoright. happens on my 13 too. memory leak confirmed, not sure yet what's causing it
- g58892881 3mo agounable to fix it. latest dev ort, dispoing tensors, restarting the session/worker. nothing, crashes every time. defaulting to wasm on ios devices now
- ekzhang 3mo agoMaybe try using https://www.npmjs.com/package/@jax-js/onnx https://www.npmjs.com/package/@jax-js/onnx ? It supports most ONNX ops and should be drop-in replacement, e.g., https://jax-js.com/d-fine https://jax-js.com/d-fine Disclaimer: I am the author
- g58892881 3mo agoalso, i double checked, nano is nano and micro is micro. didnt fuck that up
- mcbetz 3mo agoAlternative title: Text to speech in 9.36M, English only.
- billdueber 3mo agoI keep seeing tts stories here. Is it just an interesting subset of the llm world, or is there a huge use case I’m somehow missing?
- eightysixfour 3mo agoI use STT/TTS to interface with a local LLM for Home Assistant in my house.
- _davide_ 3mo agoI'm do so as well, i tried qwen3 omni 3 but it was ridiculously stupid, and i ended up with stt thinker and tts. kokoro for now
- SamPatt 3mo agoI just built my own voice assistant with my Pebble Time 2 watch and it uses a VPS hosted TTS (Piper) and Hermes agent. I learned about all of these projects on HN at one point or another.
- afdsaifdoi 3mo ago[dead]
- fintuner 3mo ago[flagged]
- phoenixranger 3mo agoamazing! was looking for something similar
- sudb 3mo agothis is extremely encouraging for individuals/small companies being able to train pareto-frontier TTS models (specifically compute required to run vs quality of model output)
- zenith605 3mo ago[flagged]
- da-x 3mo agoI think we need more neurons in the human brain than parameters in this model for speech. I wonder what it says about the human brain vs LLM efficiency.
- amelius 3mo ago[dead]
- K0balt 3mo agoHow heavy in inference on this? The model would easily fit on many microcontroller modules, I wonder if they could run it?