7 ms·
VibeVoice: Open-source frontier voice AI
- aqme28 6mo agoInteresting to see "vibe" enshrined by the likes of Microsoft as an AI product word.
- accrual 6mo agoEspecially when "vibe coded" can have a negative connotation meaning quickly put together without understanding.
- altmanaltman 6mo ago[flagged]
- Vinnl 6mo ago"get offended" is just what the clickbait news cycle made of it. It was based on the post at [1], and this is all it said: > We need to get beyond the arguments of slop vs sophistication and develop a new equilibrium in terms of our “theory of the mind” that accounts for humans being equipped with these new cognitive amplifier tools as we relate to each other [1] https://snscratchpad.com/posts/looking-ahead-2026/ https://snscratchpad.com/posts/looking-ahead-2026/
- altmanaltman 6mo agoWhen a CEO says "We need to get beyond the arguments of X" it is universally a polite, PR-scrubbed way of saying, "Please stop talking about X, it is hurting our business" which is how the media interpreted it.
- fg137 6mo agoAre you sure you have the correct reference? I think everyone else is relating to https://futurism.com/artificial-intelligence/microsoft-bans-word-microslop-discord-lock https://futurism.com/artificial-intelligence/microsoft-bans-...
- Vinnl 6mo agoHeh well, that article says it "clearly infuriated executives at the company", and links to [1], which is exactly what I described. But banning it on Discord does kind of retroactively prove their point, I suppose. [1] https://futurism.com/artificial-intelligence/microsoft-satya-nadella-ai-slop https://futurism.com/artificial-intelligence/microsoft-satya...
- lvncelot 6mo agoI'm honestly more surprised that they could resist the temptation to call it Copilot
- tempodox 6mo agoMicroslop Copilot for Voice! After they renamed Office, they surely will rename this one, too.
- amlib 6mo agoMaybe they were trying to make a pun on "Via Voice", the cursed IBM STT from the 90s?
- CubsFan1060 6mo agoGreat post last night from Simon: https://simonwillison.net/2026/Apr/27/vibevoice/ https://simonwillison.net/2026/Apr/27/vibevoice/
- 542458 6mo agoNote that this just covers the Speech-to-Text/Speech-Recognition aspect (a-la whisper), there's also models for long-form Text-To-Speech and steaming Text-To-Speech.
- JumpCrisscross 6mo ago“VibeVoice can only handle up to an hour of audio” Why?
- podgietaru 6mo agoSo we've really just settled on Vibe as the verb for AI then?
- pryanshu89 6mo agoWhy use precise technical language when you can just vibe with your AI system?
- giarc 6mo agoI'd be willing to bet it will be "Word of the Year" for 2026. Merriam-Webster had 'slop' for 2025, and 'polarization' for 2024. Is there a prediction market for this?
- internet_points 6mo agoit'll probably be something we're not even talking about yet - we still have 7 months in which to make the world even worse
- embedding-shape 6mo agoIsn't this project the one Microsoft published but then soon after pulled it for security/safety reasons? What has changed since then?
- 542458 6mo agoLook at the "News" section in the readme - The original TTS model is gone from this repo (you can still find it other places), but the SST/ASR, long form TTS, and streaming TTS models are newer.
- SingleSourceAI 6mo ago[flagged]
- infecto 6mo agoIt’s confusing (at least for me) because the project covers a number of things including what you are mentioning.
- Barbing 6mo ago[off topic] When explanations get posted directly in HN comments, I imagine someone somewhere in the world is able to learn in spite of their Internet restrictions/firewalls People will also post their own interpretations in response to comments, and quickly find out they missed something. … But if you try to automate it, like include a summary under every HN post, you encourage laziness too much and are pre-chewing too heavily. Some balance here. [on topic] (OK I’m done making excuses, time to read the article… thanks for the encouragement!) I thought this was not explained in the readme directly but in fact I missed it. I wasn’t going to read Microsoft entire changelog! But it was substantive, thanks to sibling commenter: “2025-09-05: VibeVoice is an open-source research framework intended to advance collaboration in the speech synthesis community. After release, we discovered instances where the tool was used in ways inconsistent with the stated intent. Since responsible use of AI is one of Microsoft’s guiding principles, we have removed the VibeVoice-TTS code from this repository.”
- walthamstow 6mo agoSeems quite heavy for a STT model, Parakeet and Whisper are much smaller and perform great for quick dictation and transcription of longer files. I guess that's due to additional accuracy and speaker diarisation? The TTS example clip in the repo of 'spontaneous singing' is creepy as fuck
- steinvakt2 6mo agoThis is not a new model. Also, it hallucinates a lot. Also, it's very heavy and slow in inference. It's also bad in multilingual. Edit: I'm talking purely about speech to text (STT). Not sure about the other things this can do.
- lblock 6mo agoYeah, I don't get why it is suddenly getting so much attention today, it is all over twitter too
- ramon156 6mo agowell duh, they updated the news section https://github.com/microsoft/VibeVoice/commit/e73d1e17c3754f046352014856a922f8208fb5d3 https://github.com/microsoft/VibeVoice/commit/e73d1e17c3754f... which is microsoft for "we removed two dead links". AI innovation knows no limits!
- Vinnl 6mo agoInterestingly that seems to be in response to [1], which might indeed be the trigger for this. [1] https://doublepulsar.com/microsoft-vibing-capturing-screenshots-and-voice-samples-without-governance-6973c48f03a7 https://doublepulsar.com/microsoft-vibing-capturing-screensh...
- xnx 6mo agoSimonw (who has a bit of a Midas touch for posts here) just posted about it https://simonwillison.net/2026/Apr/27/vibevoice/ https://simonwillison.net/2026/Apr/27/vibevoice/
- realty_geek 6mo agoTo be fair, his Midas touch is a result of consistency and a lot of hard work. It's like the gardener at one of the Oxford colleges said - it's really easy to create these perfect lawns, just turn up every day and trim and water it - for a couple hundred years.
- Anonyneko 6mo agoYou have selected Microsoft Sam as the computer's default voice.
- accrual 6mo agoMy friends and I had fun in the computer lab with Microsoft Sam, inputting long strings of characters to create funny sound effects. Sususususususu.
- Void_ 6mo agoI the past month or so, I added 2 models to my app Whisper Memos (https://whispermemos.com https://whispermemos.com): - Cohere Transcribe (self hosted) - Grok Speech To Text (they provide an API, only $0.10/hr!) They are both excellent. I'm not sure about this one. Would you like to see it in a consumer speech to text app?
- olejorgenb 6mo agoI've had good experiences with the Mistral Voxtral models (I've used the API, but some of the model-variants are open weight)
- 2ndorderthought 6mo agoHave you tried qwen?
- SecretDreams 6mo agoAny non-Musk alternatives that are comparable in quality and cost?
- Barbing 6mo agoDoes Cohere work with longer transcripts? Do you have to do some magic to merge recordings over 35 seconds long?
- maxloh 6mo agoI think we should stop calling this type of models open source. They are indeed "open weight." The training code is proprietary and never revealed. https://github.com/microsoft/VibeVoice/issues/102 https://github.com/microsoft/VibeVoice/issues/102
- JumpCrisscross 6mo ago> we should stop calling this type of model open source. They are indeed "open weight” This ship has sailed. It’s now in the same category as hacker/cracker and the pronunciation of GIF.
- andy_ppp 6mo agoI think you mean GIF.
- giancarlostoro 6mo agoIt's the same as GIS, you wouldn't say jizz now would you?
- notabotiswear 6mo agoI take it that you haven’t met the Arcgees people…
- DoctorOW 6mo agoI absolutely do, every single time it comes up.
- kevin_thibedeau 6mo agoThe developer of the format declared the pronunciation 30+ years ago. It has always been jif.
- Geezus_42 6mo agoYeah, but society overruled them.
- pluc 6mo agoInteresting story about this repo/product/author by cybersecurity researcher Kevin Beaumont: https://cyberplace.social/@GossiTheDog/116454846703138243 https://cyberplace.social/@GossiTheDog/116454846703138243
- deleted 6mo ago[deleted]
- tacticus 6mo agogot to love how they're trying to hide the links.
- mistic92 6mo agoFor me its giving me very poor results
- JumpCrisscross 6mo agoWhat’s the current state of the art, for each of training locally and in the cloud, for learning my voice?
- chrsw 6mo agoLocal? No idea. Cloud? Eleven Labs, probably. But it's described as "cloning" not "training". Not sure what the distinction is or why it matters if the end result is you can to generate any TTS that sounds like you. There might very well be an important one, I just don't know it.
- yreg 6mo agoLocally maybe https://voicebox.sh/ https://voicebox.sh/ Elevenlabs in the cloud.
- khimaros 6mo agoopen weights i would say S2: https://github.com/rodrigomatta/s2.cpp https://github.com/rodrigomatta/s2.cpp
- BlastBash192 6mo agoMaybe Microsoft’s real strength was never making the best model, it was knowing you don’t need to, as long as you own the platform everyone builds on.
- hedora 6mo agohttps://www.youtube.com/watch?v=d_AP3SGMxxM https://www.youtube.com/watch?v=d_AP3SGMxxM
- ryukoposting 6mo agoHoly moly, a Microsoft AI product that isn't named Copilot!
- DoctorOW 6mo agoMissed opportunity to call it Vopilot
- silverwind 6mo agoSlopilot
- frangonf 6mo agoI took a look into local options for ASR and diarization some months ago, I missed that VibeVoice now has this feature. My conclusions back then (which only came from a shallow research on the topic and 0 real experience mind you) was that Whisper + Pyannote was the "stable" approach. Have the VibeVoice, Voxtral, Qwen or the Nemo solutions caught up in segmentation and speaker recognition?
- woodson 6mo agoIt highly depends on the sort of data you’re processing (phone calls, podcasts, meetings of more people recorded using single channel?). For NVIDIA/NeMo, check out their softformer diarization models (also streaming).
- khimaros 6mo agolooks like this offers ASR support in GGUF https://github.com/CrispStrobe/CrispASR https://github.com/CrispStrobe/CrispASR -- haven't tested
- chaosprint 6mo agoMicrosoft Store App Vibing.exe Accused of Harvesting Screens, Audio, and Clipboard Data: https://cyberpress.org/microsoft-store-app-vibing-exe-accused/ https://cyberpress.org/microsoft-store-app-vibing-exe-accuse...
- ChrisArchitect 6mo agoPreviously: Sept 2025 https://news.ycombinator.com/item?id=45114245 https://news.ycombinator.com/item?id=45114245
- simonw 6mo agoThat was about the text-to-speech model, the speech-to-text one was release in January.
- starkeeper 6mo agoMicrosoft is famous for choosing terrible names but how could they be this terrible.
- Mobius01 6mo agoMicrosoft has historically made poor choices in product naming, but this has to be a new low.
- deleted 6mo ago[deleted]
- xnx 6mo agoStill waiting for the open weights model that conclusively beats the multi-year old Whisper in accuracy, features, and performance.
- scotty79 6mo agoIt's crazy that a lot is happening in open models for stt, but there's very little progress when it comes to results, esp multilingual.
- Zopieux 6mo agoEnglish only?
- mberg 6mo agoI've been using VibeVoice's ASR (speech to text) model quite intensively for the past month and have found it to be a lot more reliable and out-of-the box functional then Whisper, parakeet and other models. The fact that is has diarization built into to the model is a huge win in my book. Without that you have to run a different model just for that which adds significantly to the overall processing time vs VibeVoice which gives you reliably great results. Big fan.
- solomatov 6mo agoIt would have been better if they provided not just weights, but also some frontend where it is usable as is.
- villgax 6mo agolol they rug-pulled the 7B for our own safety some months ago
- isodev 6mo agoI think in this category, Voxtral by Mistral is a lot better. It also happens to be small enough to run on webGPU https://huggingface.co/spaces/mistralai/Voxtral-Realtime-WebGPU https://huggingface.co/spaces/mistralai/Voxtral-Realtime-Web...
- steinvakt2 6mo agoBetter accuracy than whisper large? For English? What about multilingual?
- dragonfax 6mo agoShouldn't it be called something like "Copilot Voice"?
- Narishma 6mo agoThat's not confusing enough. It should be just Copilot.
- nickandbro 6mo agoThis is a very good model, but can it be run on the web?
- yayadarsh 6mo agoSomeone tell me if this is better or worse than Parakeet
- triage8004 6mo agoSurprised it wasn't called Copilot Voice
- unixhero 6mo agoWhat the do they mean by frontier voice
- threepts 6mo agoExplains most of the shit they have pushing with Windows 11. Perhaps all that bloatware was VibeVoiced too.
- isolay 6mo agoSeriously, VibeVoice? Microslop really has a penchant for the worst names.
- simjnd 6mo agoWhat a terrible name
- low_tech_punk 6mo agoWhen mixing languages, why does the English have Chinese accent and Chinese have English accent? Is it a feature or bug?
- vijgaurav 6mo agoThe 60-minute single-pass transcription is the part that actually matters. Most ASR models chunk audio and you lose speaker continuity across boundaries. If the diarization actually holds up on hour-long recordings without drifting, thats a real solve for podcast and meeting transcription workflows.
- decide1000 6mo agoIsn't voxtral much better?
- lizardking 6mo agoMicrosoft continues to be completely incapable of coming up with good names for their products and services
- vicchenai 6mo ago[dead]
- yapyap 6mo agoSounds like Msft wanted to coast on the “vibecode” vibe popularity?
- matpb 6mo ago[flagged]
- ipotapov 6mo agoI built speech-swift, which focuses on on-device speech processing like VibeVoice, but specifically leverages Apple Silicon's capabilities for ASR, TTS, and VAD without cloud dependency. Our ASR supports 52 languages with a real-time factor of 0.06. https://soniqo.audio/benchmarks https://soniqo.audio/benchmarks
- d4rkp4ttern 6mo agoThis was on HN 7 months ago: https://news.ycombinator.com/item?id=45114245 https://news.ycombinator.com/item?id=45114245 Every time a STT/TTS model is posted I wonder if it will change my current workflow on MacOS, which is: STT with Parakeet-V3 via Hex [1] app for near-instant good-enough transcription for talking to AI agents. TTS using KyutAI’s Pocket-TTS, an amazing 100M-param model. I used this to make a "voice" plugin [2] for Claude Code So far I haven’t seen anything that replaces these for me, or haven't been persuaded enough to spend time testing an alternative (explore/exploit and all that). [1] Hex STT app - https://github.com/kitlangton/Hex https://github.com/kitlangton/Hex, which is macOS-only. (also good free/OSS alternatives: Handy, VoiceInk. No need for Wispr, Superwhisper etc) [2] Claude Code Voice Plugin - https://pchalasani.github.io/claude-code-tools/plugins-detail/voice/ https://pchalasani.github.io/claude-code-tools/plugins-detai...
- steinvakt2 6mo agoWhat do you consider to be the model with highest accuracy?
- d4rkp4ttern 6mo agoI guess you mean for STT. For my usecase of talking to AI's or coding agents, pure STT accuracy is less important than transcription speed. Transcription needs to be near-instant, and accuracy "good enough" so that the AI's can "read between the lines". Parakeet-V3 gives exactly this.
- dnivra26 6mo agoany idea on how does this STT compare to whisper large or turbo?
- leadgenman 6mo agoThis is really great. I know it's not a new model, and it does often hallucinate, but it's really great frontier open-source voice AI models.