3 ms·
I suppose this is mostly used for generation of novel subtitles, but there's probably enough infrastructure out there to combine Whisper and Llama to build a lo
by mmastrac 2y ago
I suppose this is mostly used for generation of novel subtitles, but there's probably enough infrastructure out there to combine Whisper and Llama to build a local-first closed-caption-style subtitling system.
I've seen enough bad and desynced subtitles from opensubtitles.org that could easily be fixed up with a transcription. Some of them seem to be a result of poor OCR of Bluray bitmapped captions.
- ashconnor 2y agoAegis is great for authoring new subtitles but if you're just looking to sync then take a look at https://github.com/smacke/ffsubsync https://github.com/smacke/ffsubsync Plex also recently added auto-sync subtitles to the Plex Pass https://support.plex.tv/articles/auto-sync-subtitles/ https://support.plex.tv/articles/auto-sync-subtitles/
- neckro23 2y agoI run a regular movie livestream and Whisper has been a godsend. It's really impressively accurate for the most part, at least when the audio is relatively clear. Lots of the stuff I play is long-forgotten 80s Z-movie trash, so there are frequently no official subtitles/captions available. Whisper has been a very good substitute. (It's not perfect, and it sometimes has bizarre omissions or hallucinations -- once it hallucinated a racial slur, yikes!) The English model even knows the common non-English languages pretty decently, so you can for example subtitle anime with it if you really want to. > I've seen enough bad and desynced subtitles from opensubtitles.org that could easily be fixed up with a transcription. This is what made me be wary of free subtitle sites: I discovered that sometimes (often?), the English language subtitles are simply auto-translated from, say, the Romanian subs. Amusing yes, accurate no.