5 ms·

You know... I have an idea. How about we use vosk and this tech to integrate with ffmpeg somehow so that peertube videos can get subtitles while being transcode

You know... I have an idea. How about we use vosk and this tech to integrate with ffmpeg somehow so that peertube videos can get subtitles while being transcoded. Once we get English SRT, we could use libretranslate to translate that English SRT to multiple languages. This could be similar to what YouTube does with it's automatic subtitles. What do you guys say?

harryvederci 5y ago
Sounds great! Do it!
saYu 5y ago
follower 5y ago
The package that this project is built on (vosk-api) mentions & includes some examples to demonstrate exactly that type of use case with ffmpeg: "...continuous large vocabulary transcription, zero-latency response with streaming API, reconfigurable vocabulary and speaker identification ... can also create subtitles for movies, transcription for lectures and interviews." * https://github.com/alphacep/vosk-api/blob/master/python/example/test_ffmpeg.py https://github.com/alphacep/vosk-api/blob/master/python/exam... * https://github.com/alphacep/vosk-api/blob/master/python/example/test_srt.py https://github.com/alphacep/vosk-api/blob/master/python/exam... * https://github.com/alphacep/vosk-api/blob/master/python/example/test_webvtt.py https://github.com/alphacep/vosk-api/blob/master/python/exam... (Edit: Also, thanks for introducing me to "libretranslate", looks like an interesting project.)
- 2Gkashmiri 5y ago
  great. someone should link peertube github with this. i am sure the great people will do it much faster and more elegantly :-)
  - follower 5y ago
    I just checked and apparently they are already aware: https://github.com/Chocobozzz/PeerTube/issues/3325#issuecomment-756237193 https://github.com/Chocobozzz/PeerTube/issues/3325#issuecomm... :) (Tho I'll admit I have no idea what "bluffing" means in that context. :D )
    - 2Gkashmiri 5y ago
      cool.. https://gitlab.mim-libre.fr/extensions-peertube/plugin-transcription https://gitlab.mim-libre.fr/extensions-peertube/plugin-trans... so this already exists. damn i thought i was the first one to think of this. still, this existing means there are people who think faster than me

harryvederci 5y ago

Sounds great! Do it!

saYu 5y ago

follower 5y ago

The package that this project is built on (vosk-api) mentions & includes some examples to demonstrate exactly that type of use case with ffmpeg: "...continuous large vocabulary transcription, zero-latency response with streaming API, reconfigurable vocabulary and speaker identification ... can also create subtitles for movies, transcription for lectures and interviews." * https://github.com/alphacep/vosk-api/blob/master/python/example/test_ffmpeg.py https://github.com/alphacep/vosk-api/blob/master/python/exam... * https://github.com/alphacep/vosk-api/blob/master/python/example/test_srt.py https://github.com/alphacep/vosk-api/blob/master/python/exam... * https://github.com/alphacep/vosk-api/blob/master/python/example/test_webvtt.py https://github.com/alphacep/vosk-api/blob/master/python/exam... (Edit: Also, thanks for introducing me to "libretranslate", looks like an interesting project.)

2Gkashmiri 5y ago
great. someone should link peertube github with this. i am sure the great people will do it much faster and more elegantly :-)
- follower 5y ago
  I just checked and apparently they are already aware: https://github.com/Chocobozzz/PeerTube/issues/3325#issuecomment-756237193 https://github.com/Chocobozzz/PeerTube/issues/3325#issuecomm... :) (Tho I'll admit I have no idea what "bluffing" means in that context. :D )
  - 2Gkashmiri 5y ago
    cool.. https://gitlab.mim-libre.fr/extensions-peertube/plugin-transcription https://gitlab.mim-libre.fr/extensions-peertube/plugin-trans... so this already exists. damn i thought i was the first one to think of this. still, this existing means there are people who think faster than me