sipjca

7 ms·

91.
by sipjca 10mo ago
I've also had some degree of success with Tauri but not without pains. But to be fair most of the pains have come from the state of Linux DE (it's absolute hell if you ask me) For the most part, things just work on MacOS (Windows
92.
by sipjca 10mo ago
I agree, but what about the training data that goes into it (intentional poisoning of the training data, for a variety of reasons, $, power, etc.)
93.
by sipjca 11mo ago
in some sense i think it shows having taste. sometimes taste can be dangerous. you can only have a taste for say rock climbing equipment, by rock climbing, which exposes you to danger.
94.
by sipjca 11mo ago
looks like a paid and closed source fork of the free and open source project Handy: https://github.com/cjpais/Handy can't say for sure, but a lot of the UI (and text) is quite familiar. the history page is a near
95.
by sipjca 11mo ago
seems like a flawed assumption when the cost of tokens -> 0
96.
by sipjca 11mo ago
that would be certifiably insane
97.
by sipjca 1y ago
Maybe this is true? But it's not clear to me this methodology will ever be quite as good as native tool calling. Or maybe I don't know the benchmark well enough, I just assume it's vision based Perhaps Tesla FSD is a similar
98.
by sipjca 1y ago
It also uses one of the fastest and most accurate on the ASR leaderboard, Parakeet.
99.
by sipjca 1y ago
Fair enough, most of the critical code in this case is written in Rust. A Rust transcription library popped out of the project `transcription-rs`. And there is a real-time audio library I'd like to put out which allows for filters. I c
100.
by sipjca 1y ago
Oh interesting. I totally misread the original comment, I didn't realize you're talking about RAM usage. 120MB is quite a lot. This surprises me too. There's nothing fancy going on really until the model is chosen.
101.
by sipjca 1y ago
Curious your use case, I now have quite a lot of experience with releasing desktop apps, and I have done some accessibility work as well, and may be curious to put together a TTS toolkit as well into a desktop app (or even Handy)
102.
by sipjca 1y ago
You're awesome Vlad!
103.
by sipjca 1y ago
Right now there is fairly minimal processing done to the audio. There is a VAD filter to reduce the non-speech areas. But there is no noise-reduction as such. The audio pipeline could support it though, so if you know any good real time noi
104.
by sipjca 1y ago
It's primarily this. I'm a novice Rust developer and really would like to improve the code quality across the board, and some of this comes to attracting the right kind of developers to help. Maybe "Rust" in the title he
105.
by sipjca 1y ago
What computer are you using? You really should give Parakeet a try, I find it runs in a few hundred milliseconds even on a Skylake i5 from 10 years ago.
106.
by sipjca 1y ago
thank you!!!
107.
by sipjca 1y ago
To be fair on the other side there is a fair lack of specific ML inference libraries in Rust, and this project is pushing some of that forward with Parakeet at the very least. The Rust library `transcribe-rs` came from it and hopefully will
108.
by sipjca 1y ago
Benchmarks definitely say otherwise, but my anecdotal experience says medium is the best for this application with my voice and microphone
109.
by sipjca 1y ago
Yes! Turn off “push to talk”, it will activate when you click the shortcut and stop when you click it again
110.
by sipjca 1y ago
Whisper uses Vulkan and Metal acceleration with whisper.cpp Parakeet is currently CPU only
111.
by sipjca 1y ago
Next version will have it! The main branch already has I’ve just not released the next version yet
112.
by sipjca 1y ago
A lot of the bloat comes from dependencies like ONNX or whisper.cpp to accelerate running the model itself While the UI is doing “nothing” most of the bloat is not from the UI
113.
by sipjca 1y ago
It's typescript because it is a Tauri app which uses the system webview to render the UI. Most of the audio code/inference code is Rust or bindings to libraries like whisper.cpp
114.
by sipjca 1y ago
Author here! The default recommendation is Parakeet (mainly because it runs fast on a lot more hardware), but definitely think people should experiment with different models and see what is best for them. Personally I found Whisper Medium t
115.
by sipjca 1y ago
If you prefer a more stripped down version: the original releases (0.1.0 and 0.1.1) shipped with Whisper tiny included and no auto-update feature
116.
by sipjca 1y ago
Hey author of Handy here! Would absolutely love any help, please let me know if there's any way I can make contributing easier!
117.
by sipjca 1y ago
This is super rad. Love it being Open Source, and with the option to choose local models. You’re awesome, thanks!
118.
by sipjca 1y ago
but what if you don't need to run it in the cloud
119.
by sipjca 1y ago
i mean you're also throwing away security fixed running an OS that out of date, but the person doing this probably doesn't care about security anyway.
120.
by sipjca 1y ago
i mean there are also lots of browser options to be fair. should they be locking safari to the OS, definitely not. but users can just go download another browser if they are actually concerned.

More ›