4 ms·
Cool work! I tested it and got some mixed results: 1) it throws an error if it's installed to any drive other than C:\ --I moved it to C: and it works fine. 2
by shon 3y ago
Cool work! I tested it and got some mixed results:
1) it throws an error if it's installed to any drive other than C:\ --I moved it to C: and it works fine.
2) I'm seeing huge latency on an EVGA 3080Ti with 12GB. Also seeing it repeat the parsed input, even though I only spoke once, it appears to process the same input many times with slightly different predictions sometimes. Here's some logs:
Latency to LLM response: 4.59
latency to speaking: 5.31
speaking 4: Hi Jim!
user spoke: Hi Jim.
user spoke recently, prompting LLM. last word time: 77.81 time: 78.11742429999867
latency to prompting: 0.31
Latency to LLM response: 2.09
latency to speaking: 3.83
speaking 5: So what have you been up to lately?
user spoke: So what have you been up to lately?
user spoke recently, prompting LLM. last word time: 83.9 time: 84.09415280001122
latency to prompting: 0.19
user spoke: So what have you been up to lately? No, I'm watching.
user spoke a while ago, ignoring. last word time: 86.9 time: 88.92142140000942
user spoke: So what have you been up to lately? No, just watching TV.
user spoke a while ago, ignoring. last word time: 87.9 time: 90.76665070001036
user spoke: So what have you been up to lately? No, I'm just watching TV.
user spoke a while ago, ignoring. last word time: 87.9 time: 94.16581820001011
user spoke: So what have you been up to lately? No, I'm just watching TV.
user spoke a while ago, ignoring. last word time: 88.9 time: 97.85854300000938
user spoke: So what have you been up to lately? No, I'm just watching TV.
user spoke a while ago, ignoring. last word time: 87.9 time: 101.54986060000374
user spoke: No, I just bought you a TV.
user spoke a while ago, ignoring. last word time: 87.8 time: 104.51332219998585
user spoke: No, I'll just watch you TV.
user spoke a while ago, ignoring. last word time: 87.41 time: 106.60086529998807
Latency to LLM response: 46.09
latency to speaking: 50.49
Thanks for posting it!
Edit:
3) It's hearing itself and responding to itself...
- modeless 3y agoThanks for trying it and thanks for the feedback! Yes, right now you need to use headphones so it doesn't hear itself. Sometimes Whisper inexplicably fails to recognize speech promptly. It seems to depend on what you say, so try saying something else. I have improvements that I haven't had time to release yet that should improve the situation, and a lot more work is definitely needed, this is definitely MVP level stuff right now. This stuff is fixable but it'll take time.