3 ms·
Whisper.cpp v1.4.0
- raybb 4y agoThis is really awesome. I hope that that at some point the WASM Whisper can be hooked up to WASM ffmpeg and let me drop audio files of any kind into that site. https://whisper.ggerganov.com/ https://whisper.ggerganov.com/
- emadda 4y agoI released https://bigwav.app/ https://bigwav.app/ a few months ago, it does this.
- raybb 4y agoThis works really well! Thanks for making it and sharing. Hopefully you can find some income by offering the paid services! FYI it seems to work on mobile sometimes but sometimes not at all. You might want to add a warning about when it might work or not work on mobile. Any plans to make the source available for the client side part? Thanks
- emadda 4y agoThanks, yeh at some point in the future I will likely release the source code, but it was quite a quick prototype so needs to be polished a little. Mobile is an issue, some of the web APIs only work on desktop for now. Thanks for the feedback
- tosh 4y agoAre there any end-user friendly apps yet that make whisper accessible?
- guptaneil 4y agoThis one is excellent on MacOS: https://goodsnooze.gumroad.com/l/macwhisper https://goodsnooze.gumroad.com/l/macwhisper
- mrtksn 4y agoThis mobile app uses Whisper: https://apps.apple.com/app/id6443919768 https://apps.apple.com/app/id6443919768
- tech234a 4y agoAnother one for iOS though this one uses the small/medium models which definitely pushes the system to its limits: https://apps.apple.com/us/app/aiko/id1672085276 https://apps.apple.com/us/app/aiko/id1672085276
- itake 4y agohttps://whisper.ggerganov.com/ https://whisper.ggerganov.com/ does this count?
- tosh 4y agoOh nice, iirc it used to only have the smaller models there. Thanks for the pointer.
- coder543 4y agoI’ve been playing around with various iOS apps today. Someone else mentioned “Hello Transcribe”, which is a cool demo due to how real time the transcription is, but it’s effectively unusable for anything practical because it seems to split the audio on 30 second chunks (and not in the contextual way that Whisper normally does it). Whisperboard is a free, open source iOS app (available on the App Store) that seems fairly user friendly, but there are a few crashes and bugs that the author is hopefully going to work out soon. Aiko is extremely simple to use, but it only supports the “medium” model, so it isn’t very fast, but the results are good quality. Aiko is really designed to be paired with another app, like the Apple Voice Memos app, where you can share a voice memo directly to Aiko.
- nchudleigh 4y agohttps://superwhisper.com https://superwhisper.com a macos menu bar app that uses whisper.cpp under the hood.
- maccaw 4y agoWe make both Whisper and GPT-4 available in https://reflect.app https://reflect.app
- Void_ 4y agorecord a voice memo and receive it as email: https://whispermemos.com https://whispermemos.com Uses OpenAI API so really fast
- wferrell 4y agohttps://github.com/chidiwilliams/buzz https://github.com/chidiwilliams/buzz
- daddy_chill 4y agoI’m working on a web app that uses whisper cpp wasm: https://www.transcriptey.com https://www.transcriptey.com It supports wav, mp3, m4a, and mp4. All the demuxers were written in JavaScript which was an interesting exercise. I couldn’t figure out a way using native JavaScript audio APIs to load small sections of long audio/video files without loading the entire file.
- simse 4y agoExciting to see some parts now (optionally) running on the GPU.
- rektide 4y agoFull circle eh. I wonder how well it compares to just trying to use the actual Whisper models on a variety of existing GPU capable bigger frameworks. I don't know much practically about how hard it would be to take the Whisper PyTorch (1 or 2?) trained models & to make good use of them elsewhere. I expect Whisper.cpp probably better caters to users, is more readily consumable. Doing the same integer quantization that 1.4.0 whisper.cpp does would be another ask: how hard would that be? Fwiw, Whisper.cpp uses Nvidia's cuBLAS. There does appear to be an AMD rocm port. https://github.com/ROCmSoftwarePlatform/rocBLAS https://github.com/ROCmSoftwarePlatform/rocBLAS
- angrais 4y ago>> I don't know much practically about how hard it would be to take the Whisper PyTorch (1 or 2?) trained models & to make good use of them elsewhere. What do you mean by "elsewhere"? The whisper models can be used without much effort. The tooling provided by OpenAI allows for them to be used and installed in python with ease. People use them in companies to transcribe internal media datasets. No need for CPP implementation for internal uses. Main problem is when _on device_ is required and the OpenAI model is not quantised and so use on say a smartphone becomes trickier.
- yieldcrv 4y agohow soon do you think these packages and a model will be included in modern OS?
- ntonozzi 4y agoNot soon enough, the iOS transcription is terrible compared to even the small whisper model. I really hope Apple revamps voice recognition this fall, but I'm not putting money on it being Whisper quality.
- nchudleigh 4y agoProbably really soon, especially on iOS/macos their implementation is awful. Until then... https://superwhisper.com https://superwhisper.com
- mk4p 4y agoI want to check it out but I'm reluctant when there aren't any screenshots / demos, etc. (Mentioning in case you're the developer)
- nchudleigh 4y agoYeah I need to update the marketing site Check out on https://twitter.com/superwhisperapp https://twitter.com/superwhisperapp
- ShadowBanThis01 4y agoIs what?
- deleted 4y ago[deleted]
- speedgoose 4y agoIt’s an implementation of a speak to text software. Currently the best open source one, if not the best. Particularly you can talk to it with a “international” English accent and it will work. Or French or Spanish or Norwegian… and it will transcribe English.
- canadiantim 4y agoSo could you use it to translate audio of a foreign language into english text?
- detrites 4y agoYes.
- Spivak 4y agoAnd OpenAI has a hosted version for just that https://platform.openai.com/docs/guides/speech-to-text/quickstart https://platform.openai.com/docs/guides/speech-to-text/quick...
- doublebind 4y agoYes. According to the OpenAI Whisper repo [0], when you use the 'whisper' command line tool: "Adding --task translate will translate the speech into English." I tried translating a conference with a German speaker. The transcription was superb, but the translation no so much. [0] https://github.com/openai/whisper https://github.com/openai/whisper
- canadiantim 4y agoAh I love the future. Thank you!
- aaronharnly 4y agoWhat’s the best-in-class Whisper implementation for real-time / streaming transcription? I’ve followed the various posts linked on this GitHub issue [1]; not sure if there’s more out there. [1] https://github.com/openai/whisper/discussions/2 https://github.com/openai/whisper/discussions/2
- Zetobal 4y agoWorks reasonable well in meetings. https://github.com/davabase/whisper_real_time https://github.com/davabase/whisper_real_time
- cvwright 4y agoNot Whisper per se, but IIRC LiveCaptions is partially trained using Whisper. It also works really well! https://github.com/abb128/LiveCaptions https://github.com/abb128/LiveCaptions
- andrewstuart 4y agoThere is a Tensor Lite implemenation but it might not be maintained? https://github.com/usefulsensors/openai-whisper https://github.com/usefulsensors/openai-whisper
- singularity2001 4y agopart of whisper.cpp: make stream ./stream
- ftrobro 4y agoTag v1.4.1 has been created, fixes bugs: https://github.com/ggerganov/whisper.cpp/releases/tag/v1.4.1 https://github.com/ggerganov/whisper.cpp/releases/tag/v1.4.1
- lastdong 4y agoIs there a static library implementation with easy to use interface? Also think llama.cpp would benefit from having a lib release. It would be great to easily integrate both projects in existing c++ projects.
- sebzim4500 4y agoIs there documentation somewhere on what the different quantisation methods are actually doing? E.g. what is Q4_0 vs Q4_1?
- ac29 4y agoThere's some info here: https://github.com/ggerganov/llama.cpp/issues/1240 https://github.com/ggerganov/llama.cpp/issues/1240
- simonw 4y agoWow, I'm trying out the tiny 31MB WebAssembly model on https://whisper.ggerganov.com/ https://whisper.ggerganov.com/ and it's working really, really well.
- nopcode 4y agoThese new models give me hope that computers will be able to understand me soon. As a Flemish/Dutch speaker, not a single assistant is able to understand me in my native tongue. I can use Siri in English, but then she doesn't understand things like contacts or addresses. Also I cannot dictate text messages or people think I'm a spammer.
- emadda 4y agoI released https://bigwav.app https://bigwav.app, a web app that uses Whisper.cpp via WASM a few months ago.