11 ms·
MegaPortraits: One-Shot Megapixel Neural Head Avatars
- anewpersonality 4y agoThe deepfake industry just got a lot bigger.
- shimonabi 4y agoThis is so impressive it acutally scares me.
- reidjs 4y agoWhen will something like this be available to the average user?
- zitterbewegung 4y agoIt already is https://www.thispersondoesnotexist.com https://www.thispersondoesnotexist.com is powered by StyleGAN [1] . Its on GitHub at [2] [1] https://en.wikipedia.org/wiki/StyleGAN https://en.wikipedia.org/wiki/StyleGAN [2] https://nvlabs.github.io/stylegan3/ https://nvlabs.github.io/stylegan3/
- 1f60c 4y agoThe photos at the top of the page are the researchers—the demos (two videos) are a bit further down the page.
- coolspot 4y agohttps://github.com/iperov/DeepFaceLive https://github.com/iperov/DeepFaceLive
- tomcam 4y agoHoly shit
- hansword 4y ago"Neural Head Avatar" is not a good name, but it sure beats "deepfake".
- daenz 4y agoI love the technology behind this stuff but the number of applications with negative social benefit seem to outweigh the rest.
- mrwh 4y agoI'm inclined to agree. So clever, and yet what's the actual good of it? Feels like there's a crisis in our industry (talking of the wider software engineering world) of finding real, human problems to solve. And so we end up with this, so highly advanced and yet it's not going to improve any lives (and possibly very much the reverse).
- tomc1985 4y agoIt will improve the lives of these projects' financial backers. Won't somebody think of the investors?
- belter 4y agoI can see famous actors licensing their image, with multiple shadow actors doing their moves. Now you can make 50 movies per year instead of 5. You heard it here first...
- wsinks 4y agoI've been thinking it, but I haven't seen someone else write it - see ya in 2025 Belter.
- deleted 4y ago[deleted]
- lijogdfljk 4y agoYup. As an aspiring indie game dev i eagerly await large scale emotive text to speech. Being able to write a script and have it "acted" for a fraction of the cost, possibly free if i build it myself, is kinda mind blowing.
- 4y ago
- ansible 4y agoThere are still some issues to be worked out, such as how the head shape distorts in some examples, but overall, this is very, very impressive work. Back in the old days, Disney and other animation studios rotoscoped actors performances by drawing over the original image (by hand) each frame. It won't be long now before you just have an artist create a few examples of concept art, and just video the performances of the actors without much / any special setup other than maybe wearing a tracking suit. How many years away are we from the point where you can just type in a script (or just put in some writing prompts and have an AI generate a script), describe the direction for the actors ("bend over and pick up the bucket", "exit stage left"), and then just churn out a movie? If you pick up just a little bit of skill with animation, compositing, and such you're a one-person movie studio. Crazy times. This is not what I imagined the future was going to look like, but it will be entertaining.
- keawade 4y agoWe've got AI assisted rotoscoping already and while it looks a bit janky at times its still a whole lot faster than doing it all by hand. https://www.youtube.com/watch?v=tq_KOmXyVDo https://www.youtube.com/watch?v=tq_KOmXyVDo
- IntrepidWorm 4y agoInteresting - is it still faster when the artist endeavors to correct the AI jankiness where it occurs? Or at the present day is it more trouble than it's worth?
- anigbrowl 4y agodescribe the direction for the actors What actors? There are a lot of writers who will jump at the opportunity to skip all the translation and re-interpretation by others and directly build the visuals as they go. Some of this will be extremely cringeworthy, but a lot of it will be astonishingly good.
- go_prodev 4y agoWhy stop there? How long until AI can measure my brain response and adjust the script in real time to make the film less predictable, more exciting, relaxing, humorous or engaging based on how I'm feeling? It's not a massive leap from what you described.
- moondev 4y agoThis is seriously incredible. Coolest thing I have seen in a very long time. Curious how long it takes to render one of the short example clips shown.
- m4x 4y agoIn their video they state the the optimised versions run at 70 FPS. I'm very tempted to replace my Teams camera with this.
- sebmellen 4y agoThis is perhaps the most impressive "AI" demo I've seen, and that's saying a lot. Interesting to read about the Moscow-based "Samsung AI Center" that seems to be producing this work: https://research.samsung.com/aicenter_moscow https://research.samsung.com/aicenter_moscow.
- malshe 4y agoThis is incredible! When I look at all the advances in computer vision and NLP in the last five years, I can't believe the pace of advancements. I have stopped saying "AI can't do ____ in our lifetime" to my friends.
- baxtr 4y agoI wonder how this could be used by a state actor to manipulate.
- anigbrowl 4y agoIt's very likely to be used by people who want to become state actors. And I suspect (given the source) that it's also a lowkey warning shot from a country that has a significantly deeper understanding of information and psychological warfare than its opponents.
- roughly 4y agoThere's something almost humorous about the last video being narrated by a text-to-speech system - hearing a system that clones human speech describe a system that clones human motion really adds a surrealist touch to the whole thing.
- coolspot 4y agoWait until they reveal that the whole paper was generated by some GPT-4 network.
- anigbrowl 4y agoWas not prepared for the emotional reaction to seeing Mona Lisa looking around and really smiling.
- coffee_beqn 4y agoThe paintings were super impressive
- account42 4y agoReally? I thought it failed completely on the mona lisa painting. The result looks more like a completely different face colored green but otherwise mostly ignoring the style of the painting - more like existing face swap apps than any kind of deep fake.
- bouvin 4y agoFor me, the most startling one was seeing (a) Frida Kahlo smile.
- deleted 4y ago[deleted]
- DrewADesign 4y agoI wonder which Hollywood actors will come pre-licensed in Unreal Engine 6?
- bigiain 4y agoYou get all of them in 虛幻引擎 6 and probably Нереальный двигатель 6 as well...
- xpe 4y agoHow does the algorithm decide what the side (and back) of a head looks like?
- teruakohatu 4y agoA LOT of training data.
- fire 4y agoI'm really curious how well this works on highly stylized sources like anime where landmarks aren't equivalent and in some cases may not even exist Aside, this would be sick for realtime apps, like, imagine you just get a good professional photo or two done and then drive those with your webcam? It'd be like making a vtuber of yourself
- thewanderer1983 4y agoNow Muggles get animated photos as well.
- ge96 4y agoDamn that's so good, when does it come out for a Zoom AR layer.
- coolspot 4y agohttps://github.com/iperov/DeepFaceLive https://github.com/iperov/DeepFaceLive
- imtu80 4y agoPretty neat, I wonder if the AI can take predict the voice of the person in the picture and make it talk.
- monkpit 4y agoI wonder if this type of tech could be used for animating video game characters? Instead of trying to use motion capture or something like that, just record an actor making facial expressions that would drive the 3d model. It seems like they could achieve extremely realistic results.
- Tossrock 4y agohttps://blog.roblox.com/2022/03/real-time-facial-animation-avatars/ https://blog.roblox.com/2022/03/real-time-facial-animation-a...
- awsrocks 4y ago