4 ms·
People who find this interesting might also find the work being done recently by The Companion--a service that specializes in providing fan service (writers pan
by saurik 4y ago
People who find this interesting might also find the work being done recently by The Companion--a service that specializes in providing fan service (writers panels, behind the scenes stuff, etc.) for popular science fiction content--with some researchers from Google and the showrunner of Stargate on extended episodes for Stargate SG-1 and Stargate Atlantis.
So like, the "obvious problem" with this content for Seinfeld is the "acting" (care of the TTS engine) sucks. Honestly, are the scripts bad? Maybe, sure! But actors actually do a job that can sometimes be ignored by filling in all of the subtle details that make the character the character and even then make awkward interactions suddenly "work".
In the extended work from the Google AI on Stargate, what they did was get some people from the actual cast of the show to be willing to do a table read of the AI-generated scripts (and the AI was then told to limit what it generated to using the actors they had).
And OMG sometimes it was hilarious nonsense and yet it was FUN, because the actors were kind of trying to make it all work, and they were able to lean on their backgrounds doing those characters for a decade and all of the hard-ish stuff of comedic timing but also the easy-ish stuff of how a basic human interaction works.
When we get to the point of being able to have AI actors easily pull off some of those things--having text to speech that infers enough context to know the correct emotions to apply in addition to the appropriate timing and stress as opposed to merely the correct pronunciation (which is always where we seem to be working, practically)--this stuff is going to rock, and it will be scary how well even shitty scripts do (as it isn't like many sitcoms--not saying Seinfeld, but you can easily scrape the bottom of the barrel on formulaic shows people have pumped out--have very good writing to begin with).
- BizarroLand 4y agoWait until we have multilayered AI models. One to generate the 3d scene. One for the lighting. Three for cameras. One for each actor acting out the given script along with a set amount of "improvising" and "randomness", one to generate background royalty free music based on the emotional context of the scene, one to serve as a Foley artist for environment sounds. The equivalent computer power of a medium sized bitcoin farm running everything with the only humans being the writers, the IT people running the systems, a director watching each take as it is rendered live to pick the best ones, and an editor to slap all of the takes together. That's probably technically possible now, if not actually implemented. Another 15 years or so and kids will be rendering full movies in the basement and watching them with their friends.
- pessimizer 4y ago> One to generate the 3d scene. One for the lighting. Three for cameras. One for each actor acting out the given script along with a set amount of "improvising" and "randomness", one to generate background royalty free music based on the emotional context of the scene, one to serve as a Foley artist for environment sounds. One for each hand to maintain the appropriate number of fingers.
- falcor84 4y agoIt reminds me of this old thing I heard, apparently from the Talmud: 'Every blade of grass has its Angel that bends over it and whispers, "Grow, grow"'
- jamilton 4y agoSome TTS, like Tortoise-TTS or 15.ai are decent at timing and stress, though I think they're generally more at "read an audiobook if supervised" level, and not "be a voice actor, unsupervised" level.