4 ms·

Your ideas are intriguing to me and I wish to subscribe to your newsletter.

• soulofmischief 2y ago
  I appreciate that, anything in particular catch your interest?
  • password4321 2y ago
    I am most interested in speech recognition including diarization.
    • soulofmischief 2y ago
      I'll try to find time to write about it, but in the meantime if you just want to try something that works, Xenova published some tools and examples about two months ago which I'm sure will give you a good start. https://github.com/xenova/whisper-web/tree/experimental-webgpu/src https://github.com/xenova/whisper-web/tree/experimental-webg... https://huggingface.co/spaces/Xenova/whisper-speaker-diarization/tree/main https://huggingface.co/spaces/Xenova/whisper-speaker-diariza... https://huggingface.co/onnx-community/pyannote-segmentation-3.0/tree/main https://huggingface.co/onnx-community/pyannote-segmentation-... Speaker diarization is quite difficult as you know, especially in loud or crowded environments, and the model is only part of the story. A lot of tooling needs to be built out for things like natural interruption, speaker memory, context-switching, etc. in order to create a believable experience.
      • password4321 2y ago
        Thanks for the links! Most of the fined tuned diarization models are locked up behind SaaS paywalls, not open weights usable directly.