3 ms·
You should watch how movies are made sometime. How a script is developed. How changes to it are made. How storyboards are created. How actors are screened for r
by troupo 2y ago
You should watch how movies are made sometime. How a script is developed. How changes to it are made. How storyboards are created. How actors are screened for roles. How locations are scouted, booked, and changed. How the gazillion of different departments end up affecting how a movie looks, is produced, made, and in which direction it goes (the wardrobe alone, and its availability and deadlines will have a huge impact on the movie).
What does "EXT. NIGHT" mean in a script? Is it cloudy? Rainy? Well lit? What are camera locations? Is the scene important for the context of the movie? What are characters wearing? What are they looking at?
What do actors actually do? How do they actually behave?
Here are a few examples of script vs. screen.
Here's a well described script of Whiplash. Tell me the one hundred million things happening on screen that are not in the script: https://www.youtube.com/watch?v=kunUvYIJtHM https://www.youtube.com/watch?v=kunUvYIJtHM
Or here's Joker interrogation from The Dark Night Rises. Same million different things, including actors (or the director) ignoring instructions in the script: https://www.youtube.com/watch?v=rqQdEh0hUsc https://www.youtube.com/watch?v=rqQdEh0hUsc
Here's A Few Good Men: https://www.youtube.com/watch?v=6hv7U7XhDdI&list=PLxtbRuSKCCyu4oRuZFrsj1Jw8hlXFWAFL&index=10 https://www.youtube.com/watch?v=6hv7U7XhDdI&list=PLxtbRuSKCC...
and so on
---
Edit. Here's Annie Atkins on visual design in movies, including Grand Budapest Hotel: https://www.youtube.com/watch?v=SzGvEYSzHf4 https://www.youtube.com/watch?v=SzGvEYSzHf4. And here's a small article summarizing some of it: https://www.itsnicethat.com/articles/annie-atkins-grand-budapest-hotel https://www.itsnicethat.com/articles/annie-atkins-grand-buda...
Good luck finding any of these details in any of the scripts. See minute 14:16 where she goes through the script
Edit 2: do watch The Kerning chapter at 22:35 to see what it actually takes to create something :)
- shermantanktop 2y agoI can't upvote this enough. This topic in the media space has generated a huge amount of naive speculation that amounts to "how hard could it be to do <thing i know nothing about>?"
- FranzFerdiNaN 2y ago> "how hard could it be to do <thing i know nothing about>?" This is most Hacker News comments summarized lmao. It's kinda my favorite thing of this place: just open any thread and you immediately see so many people rushing to say ''well just do X or Y'' or ''actually it's X or Y and not Z like the experts claim''. Love it.
- shermantanktop 2y agoIn this case, it’s movies and TV, which most people enjoy. So there’s a superficial accessibility to the problem which encourages this attitude. Of course, HN being the place that it is, the same type of comments are made about quantum entanglement and solar panel efficiency.
- robotresearcher 2y agoOf course normally other people contribute to a movie after the writer. My comment mentioned three of the important roles. This whole thread is about tech that automates away those roles. That's the whole point.
- dbspin 2y agoI think you've misunderstood the objection. Lets pick something concrete. It's a medieval script, it opens with two knights fighting. OK so later in the script we learn their characters, historic counterparts etc. So your LLM can match nefarious villain to some kind of embedding, and doubtless has trained on countless images of a knight. But the result is not naively going to understand the level of reality the script is going for - how closely to stick to historic parallels, how much to go fantastical with the depiction. The way we light and shoot the fight and how it coheres with the themes of the scene, the way we're supposed to understand the characters in the context of the scene and the overall story, the references the scene may be making to the genre or even specific other films etc. This is just barely scraping the surface of the beginnings of thinking about mise en scene, blocking, framing etc. You can't skip these parts - and they're just as much of a challenge as temporal coherence, or performance generation or any of the other hard 'technical issues' that these models have shown no capacity to solve. They're decisions that have to be made to make a film coherent at all - not yet good or tasteful or creative or whatever. Put another way - you'd need AGI to comprehend a script at the level of depth required to do the job of any HOD on any film. Such a thing is doubtless possible, but it's not going to be shortcut naively the way generation an image is - because it requires understanding in context, precisely what LLMs lack.
- robotresearcher 2y ago> but the result is not naively going to understand the level of reality the script is going for… We can already get detailed style guidance into picture generation. Declaring you want Picasso cubist, Warner brothers cartoon, or hyper realistic works today. So does lighting instructions, color palettes, on and on. These future models will not be large language models, they will be multi-modal. Large movie models if you like. They will have tons of context about how scenes within movies cohere, just as LLMs do within documents today.
- bunabhucan 2y agoI agree with you. At the same time I am curious in the "that person has too many fingers" sense at what a system trained on tens of thousands of movies plus scripts plus subtitles plus metadata etc. would generate. I thought about it for a bit and I would want to watch a computer generated Sharknado 7 or Hallmark Christmas movie.
- player1234 2y ago[flagged]