3 ms·
I built a C++ inference engine for NVIDIA's Parakeet speech recognition models using Axiom(https://github.com/Frikallo/axiom https://github.com/Frikallo/axiom)
by noahkay13 7mo ago
I built a C++ inference engine for NVIDIA's Parakeet speech recognition models using Axiom(https://github.com/Frikallo/axiom https://github.com/Frikallo/axiom) my tensor library.
What it does:
- Runs 7 model families: offline transcription (CTC, RNNT, TDT, TDT-CTC), streaming (EOU,
Nemotron), and speaker diarization (Sortformer)
- Word-level timestamps
- Streaming transcription from microphone input
- Speaker diarization detecting up to 4 speakers
- aaronbrethorst 7mo agoI see a number of references to macOS support in your docs for Axiom. Can this run on iOS?
- noahkay13 7mo agoTheoretically, yes? This hasent been tested but xcode has great c++ interop and the goal with Axiom and now parakeet.cpp is to be used for portable deployments so making that process easier is definitely on the roadmap.
- computerex 7mo agoOh hey I just implemented this in golang. Mine implementation heavily optimized for cpu.
- pdyc 7mo agocan you share your repo.