14 ms·

Can this be used as a real-time transcription or is it too slow for that? Curious what anyone is using these days for a real-time transcription. It doesn't hav

Can this be used as a real-time transcription or is it too slow for that? Curious what anyone is using these days for a real-time transcription. It doesn't have to be perfect, but just good enough. My kids watch some youtube vidoes where people will make a mod where it converts them talking to text then look for keywords and spawn a boss in Terraria if you say the wrong keyword etc. I made a clone of that with the .NET System.Speech.Recognition library. It... works.. but my biggest problem is that #1 it waits until you are done speaking to translate to text on the callback, so there was too much of a delay for it to be fun.. the point is that it will be checking a stream of chatter. #2 is the recognition is pretty crap, I mean it's nearly good enough for my silly purpose but it's still pretty bad.

suyash 4y ago
Depends if you're trying to run it offline or over the cloud.
blueberrychpstx 4y ago
If your family uses Apple devices, Apple offers free on-device speech recognition. Only caveat is that it needs to be restarted every minute due to whatever stupid limitation (or bug) they've introduced. https://developer.apple.com/documentation/speech/recognizing_speech_in_live_audio https://developer.apple.com/documentation/speech/recognizing... Also, see `requiresOnDeviceRecognition`
- deleted 4y ago
  [deleted]
deleted 4y ago
[deleted]
whimsicalism 4y ago
It might require too much work for what you are looking for, but the wav2letter library is the best real-time transcription OSS I have found by a considerable margin.
- davidzweig 4y ago
  Out of interest, did you try Nemo? https://github.com/NVIDIA/NeMo https://github.com/NVIDIA/NeMo
  - whimsicalism 4y ago
    No. I dont think it had streaming capabilities when i was doing this test two years ago, although i see it does now.
nshm 4y ago
Try https://github.com/alphacep/vosk-api/blob/master/csharp/demo/VoskDemo.cs#L10 https://github.com/alphacep/vosk-api/blob/master/csharp/demo...
TaylorAlexander 4y ago
The base model seems to run faster than real time on my machine. The “medium” model is larger and runs more slowly - roughly real time or maybe slightly slower.
NaturalPhallacy 4y ago
I tried it out and it's way too slow on my machine that is no slouch (Ryzen 9 5950/GTX 3080). It's doing seconds of translation per minute for me at least.
jayavanth 4y ago
thuttinger posted in this thread: https://github.com/tobiashuttinger/openai-whisper-realtime https://github.com/tobiashuttinger/openai-whisper-realtime

suyash 4y ago

Depends if you're trying to run it offline or over the cloud.

blueberrychpstx 4y ago

If your family uses Apple devices, Apple offers free on-device speech recognition. Only caveat is that it needs to be restarted every minute due to whatever stupid limitation (or bug) they've introduced. https://developer.apple.com/documentation/speech/recognizing_speech_in_live_audio https://developer.apple.com/documentation/speech/recognizing... Also, see `requiresOnDeviceRecognition`

deleted 4y ago
[deleted]

deleted 4y ago

[deleted]

whimsicalism 4y ago

It might require too much work for what you are looking for, but the wav2letter library is the best real-time transcription OSS I have found by a considerable margin.

davidzweig 4y ago
Out of interest, did you try Nemo? https://github.com/NVIDIA/NeMo https://github.com/NVIDIA/NeMo
- whimsicalism 4y ago
  No. I dont think it had streaming capabilities when i was doing this test two years ago, although i see it does now.

nshm 4y ago

Try https://github.com/alphacep/vosk-api/blob/master/csharp/demo/VoskDemo.cs#L10 https://github.com/alphacep/vosk-api/blob/master/csharp/demo...

TaylorAlexander 4y ago

The base model seems to run faster than real time on my machine. The “medium” model is larger and runs more slowly - roughly real time or maybe slightly slower.

NaturalPhallacy 4y ago

I tried it out and it's way too slow on my machine that is no slouch (Ryzen 9 5950/GTX 3080). It's doing seconds of translation per minute for me at least.

jayavanth 4y ago

thuttinger posted in this thread: https://github.com/tobiashuttinger/openai-whisper-realtime https://github.com/tobiashuttinger/openai-whisper-realtime