3 ms·
This app shows how dangerous it is to trust ChatGPT for anything even somewhat important. I just threw in a simple example news video and while it did summariz
by nebula8804 4y ago
This app shows how dangerous it is to trust ChatGPT for anything even somewhat important.
I just threw in a simple example news video and while it did summarize the video somewhat accurately(it got senator Joe Manchin's name wrong), it missed complete segments! (the "Goodbye Toyota e-TNGA" segment)
[1]:https://www.youtube.com/watch?v=UM4n1Isfr6E https://www.youtube.com/watch?v=UM4n1Isfr6E
[2]: https://i.imgur.com/RyFStVm.png https://i.imgur.com/RyFStVm.png
- ax8080 4y agoYes, it's still far from perfect, sorry about that. And it's not about the GPT. I'm sure I can greatly increase the quality on my side.
- nebula8804 4y agoYour app is slick and works great. How can you increase the quality? I thought you just pass the subtitles to chatgpt and return the results?
- ax8080 4y agoIt's not that straightforward. I would say that the most important part of pre-processing is how to break the transcript into parts. But there are many more things to improve. It's a pipeline: you can add more models, you can train them, you can change prompts, you can post-process the results. But it takes time. More time each step.
- nebula8804 4y agoAh ok then maybe I was too harsh. Your app is pretty cool. Great job!
- ax8080 4y agoOh, it's okay! In the end, what matters is how much value it gives the user, not how complicated it is inside! thank you!
- joshspankit 4y agoIf you have access to chapter markers, that might be a solid way to segment