4 ms·
Show HN: Read any YouTube video with punctuations added using AI in the browser
- ldenoue 3y agoMost YouTube transcripts lack punctuations. So this app adds them back using a deep learning model based on DistilBert converted to ONNX for inference in your browser.
- skeptrune 3y agoI saw it was running within the browser. That's beyond awesome.
- ldenoue 3y agoYes I’m also surprised how many tasks can be done using ONNX in the browser. The model I found and converted for browser use is here https://huggingface.co/ldenoue/distilbert-base-re-punctuate https://huggingface.co/ldenoue/distilbert-base-re-punctuate
- skeptrune 3y agoWow this is one of the most useful foundational AI things I have seen in a while. Is this open source? I have a really core use-case I think.
- ldenoue 3y agoIt’s not open source but I did publish the ONNX converted model to HuggingFace here https://huggingface.co/ldenoue/distilbert-base-re-punctuate https://huggingface.co/ldenoue/distilbert-base-re-punctuate It’s amazing what Xenova Transformers JS can do to run ONNX models. And WebGPU is coming soon!
- samspenc 3y agoVery cool, curious if you plan to add a summarize feature along with this? I know there are other apps that do that already, but would be good to follow along inside the same single app.
- ldenoue 3y agoI would like first to generate chapters (perhaps using a T5 model). Summarization is also possible.
- boopbeepbop 3y agoThis is great! Do you rely on YouTube captions or do some sort of ASR?
- ldenoue 3y agoIt uses the existing YouTube transcript and adds punctuations using a deep net that runs in your browser
- carlosjobim 3y agoI tried it and it worked great, congratulations! Looking forward to having chapters or at least separate paragraphs, I think you're doing right by giving that priority, as you mentioned in another comment.
- ldenoue 3y agoChapters should come first then?
- carlosjobim 3y agoIs it possible to get the chapters directly from YouTube? As many videos already have them defined by the creator.