3 ms·
Had this idea about 5 years ago, seems like it might be viable now, would love to see a video analyzer that creates relationship graphs using sentiment analysis
by sdwr 4y ago
Had this idea about 5 years ago, seems like it might be viable now, would love to see a video analyzer that creates relationship graphs using sentiment analysis. Ex. who responds to whom, what their tone is, how often. Hopefully with modern methods, it wouldn't take too many examples to pick out the dimensionality of expression (cheating out vs in, loudness + arousal, whining on the spectrum of playful to hurt, confidence, clarity)
Could test against TV shows and see if it gets an understanding of the social dynamics.
Plus could uncover a lot of the editing technique, I forget what the term is, when they create context from unrelated scenes by cutting from one to the other.
Would also pick up the general plot formula pretty quickly by mapping out the relative intensity and direction (action, tense, playful, romantic) of scenes.
I remember reading about a startup that did this or something similar for TV shows + movies a while back in the New Yorker, the idea was that they could predict how well it would do from a pilot or even the script.
- mdswanson 4y agoSome of this: https://vi.microsoft.com/en-us https://vi.microsoft.com/en-us
- sdwr 4y agoHuh, had no idea that existed. Looks a lot like this project. But no, that's not it at all. The sentiment analysis buried at the bottom there is generic. It's advertised for aggregate customer mood bc that's the only thing it's sensitive enough to detect, thumbs up or down. I mean something like https://m.youtube.com/watch?v=8dagzaFjHU4&t=2m https://m.youtube.com/watch?v=8dagzaFjHU4&t=2m, the expressions in the eyes, ex. concern - solicitous - complacent/satisfied - steely from 2:10 - 2:20. That + the same for voice tone would be everything.
- groestl 4y ago> when they create context from unrelated scenes by cutting from one to the other. Do you mean juxtaposition?
- sdwr 4y agoWas thinking of https://en.m.wikipedia.org/wiki/Kuleshov_effect https://en.m.wikipedia.org/wiki/Kuleshov_effect. That's along the same vein tho
- UncleEntity 4y ago> Hopefully with modern methods, it wouldn't take too many examples to pick out the dimensionality of expression (cheating out vs in, loudness + arousal, whining on the spectrum of playful to hurt, confidence, clarity) My first thoughts were also how this would effect the porn industry…