10 ms·
‘Deep Nostalgia’ can turn old photos of your relatives into moving videos
- deleted 6y ago[deleted]
- lostmsu 6y agoThis would also work for a scary room in amusement parks. Imagine Harry Potter-like photos of yourself + previous visitors screaming and trying to get out of the picture frame.
- withinboredom 6y agoCheck out my five minute old son looking around. Really weird. https://myhr.tg/1O7m77RK https://myhr.tg/1O7m77RK And these articulated sunglasses. https://myhr.tg/1rX4Z8Xs https://myhr.tg/1rX4Z8Xs
- hashingroll 6y agoInteresting that the AI understands sunglasses but still "blinks" them like eyes.
- SammyNameTaken 6y agoIs it really artificial intelligence and not facial recognition plus a series of image transforms
- SamBam 6y agoIt's not just an image transform, because it has to create facial features that were occluded in the original. (And correctly occluded existing features when the head turns.) In the video with the sunglasses, for instance, the computer had to invent that ear on our left. (With mixed results -- it looks a bit like Mike Tyson got at it.)
- gnicholas 6y agoThe newborn photo is especially funny because newborns don't have the requisite neck strength to be able to look around like that.
- adventured 6y agoJohn Quincy Adams came out a bit off: https://i.imgur.com/Bn0AgkJ.mp4 https://i.imgur.com/Bn0AgkJ.mp4 Straight-on photos seem to work a lot better, for obvious reasons. It's not very good at compensating proportions for turned heads. A friend of mine, her mother from eastern europe in the 1970s: https://i.imgur.com/iLc4iIt.mp4 https://i.imgur.com/iLc4iIt.mp4 That one came out decently.
- susiecambria 6y agoThere is something so wrong with that! But your son is VERY cute and not creepy at all!
- ordu 6y agoI would be just like Harry Potter, when it would be possible to print moving photos on a paper or a wall. With a sound preferably. I liked the idea of an moving image of Harry Potter repeatedly saying "Eat dung, Umbridge". Wouldn't it great to paint a graffiti saying obscene things to a passers-by? Then you could hide behind bushes and record a video how people react. Oh, and you could draw another graffiti which might answer to the first one. The city would become a different place, I'd stop using internet and start using reality again. It would be so much fun. Not for a long I expect, then morally wounded citizens would ban moving graffiti to make world boring again. But for a few years we could have a lot of fun. And then move to underground.
- siltpotato 6y agoWell, the best thing about someone leaving electronics out is that if someone smashes it, it's very hard to unsmash it.
- darepublic 6y agoYou need programmable physical paint
- wcoenen 6y agoMore likely the technology you envision would be applied to packaging and would turn supermarkets into an even more unbearable kaleidoscope.
- mysterEFrank 6y agoimagine going to a house of horrors and there's a painting of a dead relative
- flycaliguy 6y agoYikes. It’s a little scary to think I may have uploaded a photo of myself to Facebook without first reading the TOS and then consulting a futurologist to make sense of its implications.
- turbohz 6y agoImagine they use your appearance to sell insurance to your relatives...
- syntaxing 6y agoEdit: Seems like its based off of something similar to this (https://github.com/AliaksandrSiarohin/first-order-model https://github.com/AliaksandrSiarohin/first-order-model) This is pretty cool and eerie at the same time. The biggest thing to keep into mind about these algorithms is that the computer “dream” of these moving videos so they can be inaccurate. Nevertheless, seeing some moving video of my ancestors would be pretty neat.
- deleted 6y ago[deleted]
- ttul 6y agoAlas, the image you see in your head is also a dream created by your brain's neural networks.
- deleted 6y ago[deleted]
- The_rationalist 6y agoExcept brain's neural network don't work the same way
- ghaff 6y agoMy understanding (happy to be proven incorrect) is that's still a matter of disagreement. AFAIK, the idea of the brain having feature detectors of various kinds remains a matter of research as it has been for decades.
- 6gvONxR4sf7o 6y agoYou don't need to answer the general question. The brain can't be reasonably modeled by this particular neural network.
- laretluval 6y agoIt's a dream created using information from many other scenes you saw of the person. The AI "dream" is based only on the single image.
- deleted 6y ago[deleted]
- finnh 6y agoI can't be the only one who has thought that deep fakes + Cameo = moneymaker! Pitch the celebs "hey you can have 70% of the cameo money, but you don't have to lower yourself to _actually doing the cameo_". We'll just take the other 30% to pay actors to do it for you.
- black_puppydog 6y agoI see the next wave of copyright suits coming already: > 30-odd geek sued for Billions for infringing on the "Brad Pitt" brand. Interesting times...
- amelius 6y agoSo if I happen to look like Brad Pitt (I don't), then I can't have a role in a movie because of his "brand"?
- dtparr 6y agoYou can't try to imitate him to trick audiences into thinking it's him, no. That's already been a lawsuit (well, not Brad Pitt), and resulted in SAG rules against it. https://www.syfy.com/syfywire/revealed_the_real_life_dr https://www.syfy.com/syfywire/revealed_the_real_life_dr
- mikestew 6y agoThought about it? There was a movie made along those lines: https://www.imdb.com/title/tt1821641/ https://www.imdb.com/title/tt1821641/
- breck 6y agoThe Prior-Units theorem states that if you can put an idea into words, there exists prior units in proportion to the utility of the idea (so there's an infinity of novel but useless ideas). Is there a variant of this along those lines but in regards to "someone made a movie about this"?
- mc32 6y agoNow take a recorded voice snippet of the same subject and have them say hello to you or happy birthday, etc.
- saurik 6y agoIf you are trying to make me cry, I think you are succeeding :(.
- haberman 6y agoBlack Mirror comes to life: https://en.wikipedia.org/wiki/Be_Right_Back https://en.wikipedia.org/wiki/Be_Right_Back > Martha Powell (Hayley Atwell) and Ash Starmer (Domhnall Gleeson) are a young couple who have moved to Ash's remote family house in the countryside. The day after moving in, Ash is killed while returning the hire van. At the funeral, Martha's friend Sarah (Sinead Matthews) talks about a new online service which helped her in a similar situation. Martha yells at her, but Sarah signs Martha up anyway. After discovering she is pregnant, Martha reluctantly tries it out. Using all of Ash's past online communications and social media profiles, the service creates a new virtual "Ash". Starting out with instant messaging, Martha uploads more videos and photos and begins to talk with the artificial Ash over the phone. Martha takes it on countryside walks, talking to it constantly while neglecting her sister's messages and calls.
- robotwizard 6y agocame here to find this. This sort of animation is beyond the uncanny valley; far enough to wrench someone's heart who has lost someone see their dear one moving again. But alas, too removed from reality.
- siavosh 6y agoPretty magical, my parents were amazed.
- agumonkey 6y agoWe're not far from Tom Cruise A.I. dinner party
- klyrs 6y agoCharlie Sheen would be way more fun, and already loses Turing tests against GPT3
- undefined1 6y agonext step is having them talk, like this deep fake where parents brought back their dead son: https://www.youtube.com/watch?v=m6I_wEetSck&t=30s https://www.youtube.com/watch?v=m6I_wEetSck&t=30s
- jackcosgrove 6y agoDeep nostalgia audio from the early twentieth century would all sound tinny like it came from a Victrola.
- axismundi 6y agoComing soon: generating your favorite movie starring you.
- michannne 6y agoSo freaking amazing how good the 3D depth perception is on that 3rd GIF. The right side of his hair is correctly obscured when he turns his head and even his eyelids move correctly. The only slight issue is his "lazy eye", but then you could argue the AI took a little creative liberty
- dariosalvi78 6y agojust tried it with 3 or 4 pictures: some parts of the animation are convincing, but another good part is just too distorted, the tool fails to keep the shape of the head, the person becomes someone else. Good fun tho.
- markdown 6y agoDoesn't seem to work on black faces, or faces with beards.
- dpoochieni 6y agoI think they can train it for those customers or else it is an opportunity for an incumbent.
- markdown 6y agoIn fact they have a separate colorisation feature for B&W pics. It turns people white (with a pink hue), and there isn't a setting to let it know that the subject isn't white.
- fudged71 6y agoIt’s pretty amazing they will ask for money but they don’t say what the limitations of their training set are
- The_rationalist 6y agoOff topic but if you missed it: Dall-e looks like a great advance in NLU: https://openai.com/blog/dall-e/ https://openai.com/blog/dall-e/
- kiba 6y agoI am feeling scared more than amazed tbh.
- TrackerFF 6y agoA bit OT: But are any big studious (yet) applying some deep methodology to movie dubbing?
- pizza 6y agoTechnologically, it's a cool project. While we're on the subject of nostalgia.. did you know nostalgia used to be considered a serious mental illness? Although, it seems, it can do you some good, or so the research says https://www.nytimes.com/2013/07/09/science/what-is-nostalgia-good-for-quite-a-bit-research-shows.html?_r=0 https://www.nytimes.com/2013/07/09/science/what-is-nostalgia...
- karlzt 6y agoBefore doing this, think of the consequences of nostalgia. The past can be like a black hole if you get too close it pulls you again and again until you disappear.
- techer 6y ago“Get out of here! Go back to Rome. You're young and the world is yours. I'm old. I don't want to hear you talk anymore. I want to hear others talking about you. Don't come back. Don't think about us. Don't look back. Don't write. Don't give in to nostalgia. Forget us all. If you do and you come back, don't come see me. I won't let you in my house. Understand?“ Cinema Paradiso
- cbhl 6y agoIt might be nice for someone to combine one of these with a recoloring model. I remember initially being surprised when my parents told me that "the past was in color; just the photos were in black and white". Apparently, color film photography didn't really become economical until the 1960s. Being able to see black and white photos of the past with added colors can help give a better sense of what the past actually looked like. (The usual caveats about the risks of incorrect recoloring apply, of course.)
- hanrelan 6y agoThe same site (MyHeritage) has a colorizer for old photos. An open source version is available as DeOldify https://github.com/jantic/DeOldify https://github.com/jantic/DeOldify
- cbhl 6y agoOh, nice! I was thinking that this looked familiar; looks like DeOldify was submitted back in Nov 2018 (and the author left comments on HN!). https://news.ycombinator.com/item?id=18363870 https://news.ycombinator.com/item?id=18363870
- nunodonato 6y agoThere are lots of AI colored, upscaled movies of the 20s, 30s on YouTube. Quite amazing stuff
- fernly 6y agoNorman Bates: https://www.myheritage.com/deep-nostalgia/result/861467271-500001 https://www.myheritage.com/deep-nostalgia/result/861467271-5...
- Waterluvian 6y agoMy intuition is that like taxiderming a beloved pet, these will feel "not quite right" because of the lack of subtle characteristics that make the person who they are in your memory.
- sircastor 6y agoPeople may use this differently than me, but the examples shown seem to lean towards people that no one living remembers.
- 1970-01-01 6y agoUncanny valley 2.0: 1. Take the output of thispersondoesnotexist.com 2. Animate the image of the "person" using this tool 3. Profit?
- jugg1es 6y agoI used this to animate a relative of mine that we had just discovered in court documents (from a mugshot from 1926) and blew my family's collective mind. I had to keep reminding them that this wasn't real - this is an AI-driven fantasy. They did not seem capable of understanding what I was saying. I am scared of our Black Mirror future.
- tartoran 6y agoTechnically this is amazing but I find it too disturbing as a thing. This is like creeping out the past into something it was not. Again, I applaud the technical aspect of this and it was bound to happen sooner or later. Will it become a thing where we take our long dead great great grandparents for a ride? Im not sure but I hope it will not
- tomgp 6y agoYeah, I just feel deeply uneasy about this and I can't really put my finger on why, perhaps it just feels too flippant. My sister died 20 years ago and i feel like if i were to upload her image I would run the risk of overwriting my own memories of her somehow? I'm sure others feel differently but this isn't for me.
- adventured 6y agoIt's exceptionally creepy. I think you nailed part of the reason why: it's an imposter, it's fraudulent. Straight out of the twilight zone. Just wait until AI malware starts impersonating people we know or used to know in a concerted harrassment or manipulation campaign. Oh the evil shit people are going to do in the next decade or two.
- illwrks 6y agoLooking at the examples shared here I thought "that's pretty cool, and would be amazing to try, doesn't look creepy at all". I loaded a portrait of my grandmother taken 60 years ago and it's weird, uncanny valley and very very creepy to see. It's odd to see a photo you've seen many times of a person you knew so we'll come to life. It's the things that are missing, the small expressions, the details in the way they move the facial muscles, the "life in the eyes". I'm sure if it's of some long forgotten relative it would be interesting to bring a photo to life but not for someone you know.
- woko 6y agoInteresting. It gives one plausible animation, but it is one of many plausible animations. So it looks good for people whom you have never met before, because it is plausible. Yet it is not as good if you know the person, because then you are able to notice the discrepancy. It reminds me of what happens with super-resolution algorithms for tiny faces.
- twoslide 6y agoThe sign-up that requires Mother's maiden name is a bit creepy
- felixg3 6y agoI just did this with a picture of my mothers mother that died one year after giving birth to her. My mum broke out in tears (of joy). To have a tiny idea of how she looked like.
- darepublic 6y agoIt's not realy deep nostalgia... As in, it could just as easily be anyone's face right.
- Jemm 6y agoWhy does the sign in require a gender. Not sure what genitalia have to do with using a website.