3 ms·

I don't think you're missing something - Apple's built in dictation is pretty good. The biggest issue is that it still executes parts of it online via Apple's s

I don't think you're missing something - Apple's built in dictation is pretty good. The biggest issue is that it still executes parts of it online via Apple's servers and even has a disclosure that it "sends information like your voice input, contacts, and location to Apple." This project uses the on-device SpeechAnalyzer API directly and makes zero network calls, and since it's open source you can verify that nothing leaves your Mac. It also keeps a local searchable history. Finally, I also added press-to-stop with a preview so you can cancel a bad take before it inserts, instead of typing live (very useful in terminal). What type of package were you hoping it was?

heresalexandria 2mo ago
Ahh that makes sense, I was under the impression that OS dictation used exclusively on device models for dictation now but you're right - they do still send this data for transcription. That definitely changes my take and I'm interested in trying this! My initial assumption was that this was something I could invoke via CLI or within scripts to transcribe audio from files or user input using on-device models, which is something I would presently probably use Whisper for.
- pancomplex 2mo ago
  That would be a super trivial fork actually! You basically just need this file https://github.com/FrigadeHQ/yap/blob/main/Sources/Services/AudioCaptureService.swift https://github.com/FrigadeHQ/yap/blob/main/Sources/Services/... and then wrap a cli around it :)
HaloZero 2mo ago
Does the new SpeechAnalyzer API not call Apple Servers? I remember when I was building on the last version, it you wanted real time transcription you needed at least to upload it to Apple Servers for processing.
- pancomplex 2mo ago
  I think it once did! Now it doesn't - ways to easily verify this: 1) install the dmg in the GH repo 2) turn off wifi 3) use it offline
  - echoangle 2mo ago
    That doesn’t prove it doesn’t send data if it has the possibility. It could use the offline model only as a fallback.
    - ganeshmshetty 2mo ago
      yeah, this is a possibility and also they could store it and send it after we appear online.
      - RichAwo 2mo ago
        The funny thing about this project is that I own https://www.yaps.ai https://www.yaps.ai which is also offline dictation, amidst a ton of other things (e.g. speech generation, meetings, video editing, etc.). And I legit thought this thread was about my tool until I opened it up.
earthpyy 2mo ago
I was having the same question, now it makes sense.

heresalexandria 2mo ago

Ahh that makes sense, I was under the impression that OS dictation used exclusively on device models for dictation now but you're right - they do still send this data for transcription. That definitely changes my take and I'm interested in trying this! My initial assumption was that this was something I could invoke via CLI or within scripts to transcribe audio from files or user input using on-device models, which is something I would presently probably use Whisper for.

pancomplex 2mo ago
That would be a super trivial fork actually! You basically just need this file https://github.com/FrigadeHQ/yap/blob/main/Sources/Services/AudioCaptureService.swift https://github.com/FrigadeHQ/yap/blob/main/Sources/Services/... and then wrap a cli around it :)

HaloZero 2mo ago

Does the new SpeechAnalyzer API not call Apple Servers? I remember when I was building on the last version, it you wanted real time transcription you needed at least to upload it to Apple Servers for processing.

pancomplex 2mo ago
I think it once did! Now it doesn't - ways to easily verify this: 1) install the dmg in the GH repo 2) turn off wifi 3) use it offline
- echoangle 2mo ago
  That doesn’t prove it doesn’t send data if it has the possibility. It could use the offline model only as a fallback.
  - ganeshmshetty 2mo ago
    yeah, this is a possibility and also they could store it and send it after we appear online.
    - RichAwo 2mo ago
      The funny thing about this project is that I own https://www.yaps.ai https://www.yaps.ai which is also offline dictation, amidst a ton of other things (e.g. speech generation, meetings, video editing, etc.). And I legit thought this thread was about my tool until I opened it up.

earthpyy 2mo ago

I was having the same question, now it makes sense.