7 ms·
AMC Theatres will screen a Swedish movie 'visually dubbed' with the help of AI
- slater 2y agoFirefox Can’t Open This Page To protect your security, guce.engadget.com will not allow Firefox to display the page if another site has embedded it. To see this page, you need to open it in a new window. Learn more…
- guywithahat 2y ago[flagged]
- Conscat 2y agoHow am I supposed to live without rr
- guywithahat 2y agoYou could just leave the bugs in \s
- knowknow 2y agoWhy is Firefox considered bad now? Is Mozilla any worse than Google?
- natebc 2y agoNope. Not even in the same ballpark.
- eikenberry 2y agoI don't think Ladybird is ready yet and Chromium has taken itself out of the running with manifest v3. Ie. what do you suggest that isn't Chromium or Firefox based?
- exe34 2y agochrome works fine for me! have you tried restarting your computer?
- eikenberry 2y agoChome is Chromium based and therefore V3 as well.
- exe34 2y agoyes, and it works fine as a browser.
- ks2048 2y agoWorks for FF 36.0.1 on macOS.
- mondobe 2y agoWorks for 136.0.2 on Windows
- sleepydog 2y agoI noticed Netflix doing this while watching this series: https://about.netflix.com/news/beyond-goodbye-premieres-november-14 https://about.netflix.com/news/beyond-goodbye-premieres-nove... It was so jarring I couldn't watch it and switched to Japanese with subtitles. Their mouths looked so stiff and unnatural and out of sync with their expressions that all me and my wife could talk about was how bad it looked.
- SirFatty 2y agoYes, Kung Pow is a great example of how jarring it can be! :-D
- aaron695 2y ago[dead]
- chedabob 2y agoIt was quite jarring in Amazon's Citadel Diana. The voices were ever so slightly out of sync with the lip movements, and the audio sounded like the studio recording hadn't been processed to match the environment.
- lambdaone 2y agoYou can see a lot of open mouth/tongue stuff being skipped. Dealing with the tongue and the inside of the mouth is a huge problem with this sort of visual dubbing. Using traditional techniques, you can model teeth and gums as rigid bodies, and faces as rubber sheets (to first approximation), but tongues, for which you typically have no visual reference in any given shot, are much more difficult to model, and continuously, subtly, on the move. "AI" is the general answer to this problem nowadays, but even ML-based systems struggle to deal with the tongue issue while trying to reconcile visual appearance with animation fidelity.
- bbstats 2y agoIt looks pretty bad https://youtu.be/PTngv5MmtXo?si=cCQcYtRaja5pPP6a https://youtu.be/PTngv5MmtXo?si=cCQcYtRaja5pPP6a
- gruez 2y ago??? https://youtu.be/PTngv5MmtXo?t=105 https://youtu.be/PTngv5MmtXo?t=105 They're admittedly pretty cagey with the parts they're willing to show, but the parts they did show look fine to me. Are you referring to the parts when they showed the 3d mask overlay on top of the characters?
- Symbiote 2y agoIt's very difficult to judge from these tiny clips. They're supposed to be showing off the technology with this video, but choose many clips with very little dialogue.
- romanhn 2y agoI agree with the parent poster. They've chosen the best examples to show off, and yet all of them looked "off" to me. Perhaps because I was paying close attention I was more likely to notice it, but there was definitely an uncanny valley effect to it all.
- marginalia_nu 2y agoTo be fair a lot of the same applies to conventionally dubbed films, and then some.
- Rebelgecko 2y agoIt kinda reminds me of some of the old multiplayer PlayStation games that would flap your characters gums when you used the mic. The motion lines up with the words more or less but it lacks any sort of emotion or emphasis like you'd see with real actors
- bbstats 2y agoA few examples are very "gum-flappy"
- jedberg 2y agoOn the one hand, as a lover of film, ewww gross. On the other hand, as a lover of film, if this will bring more audience to foreign films, then let's give it a try. This is very much in the same vein as colorizing black and white movies, pan-and-scan for video releases (and now zoom for 4:3 content on widescreen), and dubbing instead of subtitles. Every one of those things brought in more viewers of the content, exposing more people to those films.
- dangus 2y agoIf it looks good it's fine, but I'm not as optimistic as you. I would argue that pan-and-scan failed long-term, perhaps even short term. I remember widescreen releases being available on VHS because a significant amount of people didn't like it. Colorizing black and white movies...I can't think of any time I've seen that done in a commercially successful way. I also think that a dub with lips that don't match is something people barely notice in the first place.
- deleted 2y ago[deleted]
- voltaireodactyl 2y agoI want to be on board with the “bring more audience” but the truth is knowing how this industry works, any success with AI on this front will lead almost immediately to a total drying up of funding for professionals engaging in this work currently. I hope I’m wrong, I really do.
- Zanni 2y agoWhat professionals are doing this work already? As I understand it, this is something that can only be done by AI (or by shooting the movie twice in different languages).
- chii 2y agoaudio dubbing and voice acting is a thing. They even do it in a way that takes into account the mouth movement length/timing, to make it look slightly more natural a dub. of course, it's not super good imho, and personally i prefer subtitles with the original audio. Even if ai did a perfect job, including changing the film's frames to suit etc, i dont believe the outcome is sufficient. I want the original actor's voice timbre and intonations, which has meaning, and is lost when translated to a different language.
- iancmceachern 2y agoI can't wait for the corridor crew episode about this
- tantalor 2y agoI support this, if only because I prefer dubs over subs, and this will make dubs much more worthwhile for the studio to get right, as well as better viewer experience.
- ks2048 2y agoSo, only the video was changed to match real dubbed audio? Or synthetic audio? Only a matter of time, for better or worse, until translation, synthesis, and visual modification all done with AI.
- nh23423fefe 2y agothe article has the answer
- CaptainFever 2y agoTFA: > Notably, the original actors recorded their own dialogues in English in a sound booth — Flawless AI's technology merely altered the movements of their lips in the movie.
- timewizard 2y agoIt's an algorithm. Why are we calling it "AI?" Did they literally ask a machine "visually dub subtitles into this movie file for me please" and get a result? No? They didn't use AI then. They used a purpose built model in a purpose built tool to perform a single algorithmic function. how that algorithm works or what technologies it's similar to are not relevant. /curmudgeon
- shermantanktop 2y agoWe've had things we call "AI" since the 1950s. We only had text prompting as an interaction mode since ChatGPT came out in 2022. Why is prompting your test for whether something is "AI" or not?
- timewizard 2y ago> We've had things we call "AI" since the 1950s. We only had text prompting as an interaction mode since ChatGPT came out in 2022. This is not even close to true. SHRDLU would be one prominent example. > Why is prompting your test for whether something is "AI" or not? What does the initialism AI stand for?
- shermantanktop 2y agoTIL about SHRDLU. But regardless, when you say "AI" in 2025, it means something broader than that. The root of the tree may look like trying to pass the Turing test, but many of the leaves don't. Call it what you want, but there are lots of video processing tools out now with a technology lineage which includes generative/FM/LLM/NN DNA. Not sure about this one, but I know for sure of others.
- namaria 2y agoAI is just a marketing term for software at this point. It's become essentially meaningless.
- bdhcuidbebe 2y ago> It's an algorithm. Why are we calling it "AI?" And inference isnt? Explain your reasoning pls.
- fifilura 2y agoI am really curious how it handles the Norrköping dialect in this film! In particular the SMHI security guards "stället måste outoymmas, det finns en bomb i huset".
- chrononaut 2y agoAs someone who doesn't speak Swedish, what makes this particular passage interesting, and what is it about the Norrköping dialect makes it interesting? (I have attempted to study Swedish briefly, but I feel like I need to do more sustain discovery of content to consume in order to keep me engaged long term)
- deleted 2y ago[deleted]
- Manfred 2y agoModels need a large set of training data to work properly and dialects are usually underrepresented in the training data.
- cess11 2y agoThe National Library and public service television has done some work in this area. You can find models here: https://huggingface.co/KBLab https://huggingface.co/KBLab More information in swedish about the process here: https://www.kb.se/samverkan-och-utveckling/nytt-fran-kb/nyheter-samverkan-och-utveckling/2025-02-20-valtranad-ai-modell-forvandlar-tal-till-text.html https://www.kb.se/samverkan-och-utveckling/nytt-fran-kb/nyhe...
- eesmith 2y agoI'm going to make a guess. I suspect the question is, will the translation to English convey the regional dialectal nuances of the original Swedish? Decades ago I read one of Douglas Hofstadter's writings about Gorbachev's accent. (As least, I think it was Hofstader. He wrote a lot about issues of what it means to translate.) Gorbachev had a distinct southern Russian accent, which affected how Russians viewed him. "Gorbachev’s southern speech is held against him." - https://time.com/archive/6732598/mikhail-gorbachev-3/ https://time.com/archive/6732598/mikhail-gorbachev-3/ More strongly, one Redditor writes "Gorbachev couldn't fucking pronounce Azerbaijan for a living, he sounded like a self-important moralistic buffoon." - https://www.reddit.com/r/AskARussian/comments/tw3zlm/what_does_putin_sound_like_when_he_speaks_russian/ https://www.reddit.com/r/AskARussian/comments/tw3zlm/what_do... However, Americans mostly heard Gorbachev through translation. Should the translator use General American English? Or use a US Southern accent? Perhaps a Foghorn Leghorn accent? When you watch a Russian movie in English, do you expect English with a Russian accent (often fake), like in The Hunt For Red October? Or do you expect to hear people talking with strong regional US accents, so characters from Saint Petersburg might have, I dunno, a Chicago accent? We see this in Peter Jackson's movie interpretation of "The Lord of the Rings", where the actors used regional English accents to portray the social and economic standing of characters who spoke Westron. Based on what I read about this AI-assisted translation, they are using the original actors but speaking English, which means the dialectal nuances will not be interpretable by non-Swedish viewers.
- ks2048 2y agoReminds me of the minor controversy about The Brutalist using AI to fix up Adrien Brody's Hungarian speech. Done by respeecher.com https://www.vanityfair.com/hollywood/story/the-brutalists-ai-controversy-explained https://www.vanityfair.com/hollywood/story/the-brutalists-ai...
- panzagl 2y agoDo I have to be the old guy that brings up Clutch Cargo? https://youtu.be/J8P3vZo-0Hc?t=169 https://youtu.be/J8P3vZo-0Hc?t=169
- cratermoon 2y agoI feel like Clutch Cargo was only the most successful (however limited you define that) of range of cartoons that used that technique.
- snug 2y agoI support this simply just on the fact that maybe they wouldn't have remade Danish film "Speak no evil" (2022) which was such a great movie into one of the worst movies I've seen this year, the American film "Speak no evil" (2024)
- nottorp 2y agoAnything but subtitles lol
- sounds 2y agoI think this is gaining a lot of awareness, for example Derbauer (English channel) used Visual AI translation here: https://www.youtube.com/watch?v=UlZWiLc0p80 https://www.youtube.com/watch?v=UlZWiLc0p80
- cratermoon 2y agos/AI/work stolen from artists, actors, and writers/
- gblargg 2y agoThey had the original actors record the lines to dub. They didn't necessarily have the budget to re-shoot the entire movie with them saying the lines in English, so that's not work lost. The "AI" here is a program that manipulates their faces to match the English syllables. All I see here is the creation of more work for people to do, not less (dubbing/subtitling it would likely bring a smaller audience).
- ano-ther 2y agoI found Swedish quite easy to understand, eg in this classic: https://www.youtube.com/watch?v=Fw4ylHuBOVk&pp=0gcJCdgAo7VqN5tD https://www.youtube.com/watch?v=Fw4ylHuBOVk&pp=0gcJCdgAo7VqN...
- dudus 2y agoAs someone that grew up in a Latin America country watching dubbed movies my whole life I welcome this technology. Dubbed movies are usually terrible with subpar performances and recycled voices. It sucks it will kill a large field for actors, but AI has the capacity to be much better with voices and performances that mimic the actors.
- CaptainFever 2y agoNote that for this movie, the actors are recording the translated lines manually. The AI is just there to change the lips.
- hiisukun 2y agoI would love a way to regularly discover and watch some top, 'hit' TV shows or movies from outside of America or Australia (my home country), or sometimes England. I have no issues watching things with subtitles, but it is quite difficult to organically find things to watch, that perhaps have 'not English' as their primary language. For example, I will now look up the UFO Sweden show to see if I might like to watch it -- because I discovered it through here. I have tried subscribing to a few different regular streaming services, but none seemed to work even if I pointed them in the right direction. I'm really not particular about which country of origin the production has, so long as it's "the best" or "very popular" in recent times from that place, it's worth me checking the genre and style to see if it piques my interest. Any advice on this? [ nb. I have a similar issue with podcasts! ]
- dpig_ 2y agoI'm learning a language, and I'd love to be able to filter Netflix titles by language, but they absolutely refuse to do it (I assume because allowing users to filter content would expose how bare the offerings are).
- intothemild 2y agoNetflix, and other streaming is absolutely the worst at stuff like this. Another thing is Subtitles in every language. They ONLY show subs in a handful of languages, even though the subs are in every language. For instance, I live in Norway, it's common to see subs in only Norwegian, which makes sense. But imagine you're a tourist/immigrant, etc. Maybe you want to watch this Japanese movie, well, now the audio is in Japanese, and the Subs are in Norwegian. The app knows your language preference... but shows the subs for the country you're in. Even though Netflix/etc has the rights to the streaming. It's baffling to me, and I must be missing a piece of the puzzle. But I'm forced as someone who's still learning Norwegian, to skip all Non-English media, OR pirate them so that I can get subs in whatever language I choose. (Yet another example of how piracy is the better UX)
- cess11 2y agoYou might enjoy https://easterneuropeanmovies.com/ https://easterneuropeanmovies.com/, https://sovietmoviesonline.com/ https://sovietmoviesonline.com/ or https://asian-movies-online.com/ https://asian-movies-online.com/. They have both movies that are popular hits and that have been important to the craft and history of the art. Subtitles are usually from open sub-style sources so not professional quality, but I find it sometimes help with learning the language when it's more literally translated than idiomatically.
- actionfromafar 2y agoIt's a pretty good movie.
- bdhcuidbebe 2y agoIts a cool movie but boy I wish people just learnt to read subtitles.
- yapyap 2y agough, I don’t think it’s a bother to watch unsynched footage with a dub or just read the subtitles the whole movie through What WOULD bother me is AI artifacts in a movie I paid to see in theaters.
- mrb 2y agoI grew up watching foreign movies almost exclusively dubbed. French TV in the 1980s-2000s dubbed everything; it was nearly impossible to watch stuff with the original audio track. And I will say something that will probably surprise most of you: up until age 10-12 I never noticed the lips didn't match precisely the voices and I never even realized it was dubbed(!) Even when I learned most of what I was watching was dubbed (there is so much American content on TV) it did not seem obvious to me. It certainly never bothered me. Maybe my brain subconsciously realized watching the lips was not giving out much information, so I learned to ignore lips. Even today as an adult, if I don't know the actors and I watch a French dub, I am not able to instantly tell it is a dub. I have to watch carefully for at least 10-20 seconds to make a guess. Maybe this speaks more of the fact that French dubs are actually really well made (they will choose translations so that French word cadence matches the English word cadence). On the other hand I have watched other dubs, especially non-English movies dubbed in English, where it's blatant that they were dubbed and it is very distracting. In any case, I always get a kick when I tell my American friends that I watched US content dubbed all my childhood and it never bothered me :-)
- pingou 2y agoInteresting, it would be interesting to see if people who have grown up with dubbed movies pay less attention to lips when listening. I'm french and I'm terrible at understanding speech when in a noisy environment for example. But I didn't grow up with tv so that's probably not it.
- ahartmetz 2y agoGerman dubs are smilarly well done, but the result often sounds slightly like the original language in tone and cadence, which is recognizable if you know what to look for. Someone I know can do a quite funny exaggerated version of German-from-English. Extreme example: children say "maMA" (strongly stressed on the last syllable, opposite of German) in dubbed French movies. It's actually a little annoying, haha.
- vodou 2y agoA bit off-topic maybe: I really think the earlier film made by the same production team (Crazy Pictures), "The Unthinkable" [1], is a much better film than "Watch the Skies". But apparently IMDb does not agree: "The Unthinkable", IMDb rating 6.0 "Watch the Skies", IMDb rating 6.4 [1] https://www.imdb.com/title/tt5227746 https://www.imdb.com/title/tt5227746
- cwmma 2y agoThe very few shots they showed in the demo video, which one could assume were the best ones they wanted to highlight, do not look good, like it's not as bad as Ice Ice Matrix [1] but it does not look good. 1. https://www.youtube.com/watch?v=gnEIeVWLtbU&pp=ygUOaWNlIGljZSBtYXRyaXg%3D https://www.youtube.com/watch?v=gnEIeVWLtbU&pp=ygUOaWNlIGljZ...
- hulitu 2y ago> AMC Theatres will screen a Swedish movie 'visually dubbed' with the help of AI So, a new version of the Python's "Hungarian phrasebook" all over again.