4 ms·
Kira Vale, $500 and 600 prompts, AI generated short movie [video]
- Bluestein 1y agoFrom YouTube, which, I second: "Pinned by @hashemalghailiofficialchannel @philipashane 4 days ago (edited) I’ve been wondering when this day would come, when we’d see an AI film that was just a damn good film, without the distraction of AI blemishes. This is well written, well directed, well edited, just about everything is top notch. The “acting” isn’t stellar but nor is it bad. This is very impressive and a landmark achievement, kudos to you."
- leakycap 1y ago> without the distraction of AI blemishes Maybe I'm just detail oriented, but "police" wasn't even spelled right on the officer's sparse uniform. That isn't even half way into the movie, and by then I'd spotted dozens of other weird AI details.
- Bluestein 1y agoFair enough.- I think the point being not "no blemishes" but "story and execution good enough for blemishes not to be distracting" still stands.-
- leakycap 1y agoThe point is that if you are looking for any amount of details, you will notice this was full of AI blemishes. The common word "POLICE" misspelled with non-letters on an otherwise empty uniform was an obvious one, but so was the historical singer's face changing in just the first few cuts.
- dragonwriter 1y agoI...don't. The story was fine, and the execution was understandable given the state of the tooling, but viewed as a film and not a tech demo of advances in what is acheivab;e with modern AI tools it's not great. Many of the voices have the same very noticeable robotic features, and the delivery, whether narration or diegetic dialogue, is monotonous; the "angry crowd" is almost the only place in the whole work that speaking voices appear impacted by emotion, and even that feels off. The scenes have consistent, very limited range of lengths and a very limited palette of simple continuous camera movements, consistently using one per clip. Even though the mockumentary format is an excellent choice for minimizing the impact of several of those problems, they are still pretty glaring there, even if less so than if you tried to make literally any other style of film with the same techniques.
- Bluestein 1y agoI really appreciate your insightful look into this, and will again view the video with an eye to these issues you point out.- PS. We might be a tad beyond "train arriving at the station" territory, at least - that much can be granted methinks.-
- stubish 1y agoIt reminded me a lot of many video game cut scenes. It is still hitting uncanny valley a lot. eg. Voice acting recorded phrase by phrase with limited context and odd pacing better suited for the stage. Acting by puppets with somewhat inhuman movement.
- vannevar 1y agoThis short is an amazing achievement, and (at least to me) a very skillful and clever use of AI. But I don't think it's a good film. And that has nothing to do with AI blemishes. If it had been made shot-for-shot without AI, I probably wouldn't have watched til the end. If I had to put my finger on it, I'd say we spend way too long with a character (the only character) we don't ever really know. The sort-of movie reel concept that keeps her at a distance could work, but I think it would need to be cut way down, maybe half the time. Cutting the clone comeback (which doesn't really advance the plot) would save 4 or 5 minutes.
- leakycap 1y agoThis reminded me of Youtube videos that are one stock video after another: the emotional moments didn't register as real or have a feeling of continuity as the story unfolded. Amazing, especially for $500 - but this feels like Fiverr Pixar to me, even in this advancing state of the art.
- techpineapple 1y agoI wonder if anyone has tried to replicate a AAA movie scene from a prompt, or it would be interesting to try and do a whole movie. I’d want to see the side by side, but the Only problem is since that movie might be in its training data, it might not make a good test.
- leakycap 1y agoThat's what I've noticed: if you reference something real that exists in an LLM's training, it will cling onto that because it then has something credible to work from. On the other hand, it is also challenging to accurately describe an AAA movie scene in any terms where the AI won't then connect the dots to a familiar scene from an AAA movie and incorporate those details.
- justinclift 1y ago... or refuse to do the work if it recognises the scene/movie/artist (etc).
- 1oooqooq 1y agoit's way more than 500 when you account for the month of extreme editing by the author. you probably couldn't hire him for a week for 500 let alone half a month of overtime.
- techpineapple 1y agoI’m curious if there’s a limit in how good AI can get at movie making. I think it will take revolutionary new algorithms/tech. This video is a great example. Looks great, sounds great, but also looks like a really good amateur found a bunch of clips on a stock video site and edited them together, probably because stock video is a really plentiful source of learning data. The interviews look the best, but again, lots of interviews in the training data. When you combine the skill it takes to generate good prompts, with the lack of sufficient training data, I’ll just say I don’t think Christopher Nolan has anything to worry about just yet. Maybe Wes Anderson does though.
- jaggs 1y agoThis is probably the worst it's ever going to be?
- techpineapple 1y agoThat’s not incompatible with a ceiling. I’m not sure what the point you’re trying to make is?
- polytely 1y agoI don't think Wes Anderson has anything to worry about either, it isn't only panning shots in pastel colors.
- fouc 1y agoI wouldn't be surprised if the video models were vastly undertrained compared to our text models. There's probably millions of hours of video we haven't used to train the video models yet. Still seems like early days on this tech. We're nowhere near the limits. Just a year ago we could only create the distorted video of Will Smith eating spaghetti. A year from now this is going to be even more flawless.
- techpineapple 1y agoBut what does flawless mean, how is this not flawless? I see very few “flaws” in this. But the comprehensiveness of the video training space is probably just miniscule compared to photo and text.
- boznz 1y agoThe film is about us not accepting a clone for the original. The massive irony is that the film is likely going to generate the same response from the commenters.
- fouc 1y agoAt a meta level it is also about LLMs/AI generated content too, the twist at the end makes that clear.
- fouc 1y agofrom the reddit post: AI tools used to make this short film: Image Generation: Whisk, Runway, Midjourney, Dreamina, Sora Video Generation: FLOW & Veo 3, Dreamina, HIGGSFIELD, Kling AI Voice Generation: ElevenLabs Lip Sync: FLOW & Veo 3, Dreamina, HeyGen Music Generation: Suno AI Sound FX Generation: MMAudio, ElevenLabs Prompt Optimization: ChatGPT
- superfunny 1y agoJoanna Stern at the Wall Street Journal presented a project earlier this year where she and a team of editors created a short film using AI tools - not exactly the same thing here but the results were very good. They had a bigger budget too. You can see it here: https://www.youtube.com/watch?v=US2gO7UYEfY https://www.youtube.com/watch?v=US2gO7UYEfY In their case, they interspersed live actors with AI-generated imagery.