5 ms·
Generative Image Dynamics
- FrostKiwi 3y agoThat's one step away from Harry Potter style photo frames for static photos.
- mdrzn 3y agoWow! This seems surreal, can't wait to have it integrated into Photoshop.
- Hard_Space 3y agoThis suffers from the same low-vector movement requirements as EbSynth.
- GaggiX 3y agoI think the achievement here is mostly about generating the image dynamics, so for example there is a cat in an image, the model understand that cats need to breathe so the dynamics show the lungs contracting, then the paper covers how to traslate the image dynamics and the image itself into a seamless video. I could be wrong tho
- deleted 3y ago[deleted]
- soultrees 3y agoThis is super cool. Cinemagraphs have always been a bit of a passion of mine, and I try to bring that feeling of subtle-stillness in a lot of the work I do, whether it’s marketing or shooting, so i can see this becoming a regular tool. The trick to a 10/10 cinemagraph is the more subtle, the bigger the impact. You almost want the viewer to think it’s a still photo before their brain clicks in thinks “wait, something isn’t normal here, this isn’t a photo, it’s a video”
- albert_e 3y agoany good examples you can share please?
- nextaccountic 3y agothere's a subreddit about that check out www.reddit.com/r/cinemagraphs/top
- nico 3y agoNot op, and not sure if these qualify as cinemagraphs, but they kinda fit the “subtle image movement” description https://twitter.com/nicobrenner/status/1685754265393041408?s=46 https://twitter.com/nicobrenner/status/1685754265393041408?s... https://twitter.com/nicobrenner/status/1686074457159274496?s=46 https://twitter.com/nicobrenner/status/1686074457159274496?s... https://twitter.com/nicobrenner/status/1685875401351217152?s=46 https://twitter.com/nicobrenner/status/1685875401351217152?s... https://twitter.com/nicobrenner/status/1686060465783443457?s=46 https://twitter.com/nicobrenner/status/1686060465783443457?s... https://twitter.com/nicobrenner/status/1685170395086045185?s=46 https://twitter.com/nicobrenner/status/1685170395086045185?s...
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- nico 3y agoImpressed and sad with how toxic HN can be sometimes Just sharing some art here, and getting downvoted without even a comment about it. And even getting flagged @dang care to check what’s going on here?
- puffyblogger 3y ago[dead]
- 3y ago
- deleted 3y ago[deleted]
- CSSer 3y agoThey used webGL for the demo. Nice!
- sva_ 3y agoThis would be crazy in a video game. Walking through a bush and dragging the plant with you
- dragonwriter 3y ago> This would be crazy in a video game. Walking through a bush and dragging the plant with you. But game physics can handle stuff like that, there's no need for GenAI.
- esperent 3y agoI've been playing Red Dead Redemption 2 recently. When it comes to 3D nature scenes, this game is state of the art, and incredible in its attention to detail. Still, one of the things that stands out to me is how fake the small movements of leaves, grass, and flowers in the wind still feels. The actual physics of tree branches as you push past them isn't bad, but you can't use the physics engine for every leaf. The wind in trees and grass is still just a randomized oscillation of some kind that doesn't quite feel real. So I was immediately struck that this technique would be an improvement, perhaps using animated billboards. But it would come with its own issues - can't be done in real time any more than physics, for example, so it would be hard to use it for real time weather systems. And anyway, in that case since you're using a transparent video, there's probably easier ways to make it.
- solardev 3y agoRDR2 was good for its time, but is it really state of the art these days? Seems like other games have pretty good grass... Horizons Forbidden West: https://youtu.be/COY-pKl1BJY?si=uDrWYAqAlAiNVKZ8&t=16 https://youtu.be/COY-pKl1BJY?si=uDrWYAqAlAiNVKZ8&t=16 Crysis 3: https://www.youtube.com/watch?v=4_WwYMFS8EM https://www.youtube.com/watch?v=4_WwYMFS8EM Zelda BOTW: https://www.youtube.com/watch?v=1T7Z-u_JfmE https://www.youtube.com/watch?v=1T7Z-u_JfmE Or in UE5: https://youtu.be/Dj60HHy-Kqk?si=-iLHHWEH3cOEo-2L&t=42 https://youtu.be/Dj60HHy-Kqk?si=-iLHHWEH3cOEo-2L&t=42 https://www.youtube.com/watch?v=AShGmWyFamY https://www.youtube.com/watch?v=AShGmWyFamY https://www.youtube.com/watch?v=ZP_9DUhXVbk&t=2s https://www.youtube.com/watch?v=ZP_9DUhXVbk&t=2s
- divyajg 3y agoI wonder why in the first picture (red rose) the flower in the bg also moves, but we don't see the same affect in the third picture (tree). I also find it impressive that the amount of motion differs in the first and the second picture, could it be because the density around the pointer is considered? The slo-mo ones are super relaxing to watch!
- actionfromafar 3y agoI don't know why but I reacted with slight fear to the rose ones.
- juunpp 3y agoThe tree has severe distortion when dragged from the edge. Still an interesting idea.
- Timon3 3y agoYou'd probably have to combine this with segmenting and generative infill for the background layers, but luckily there's been a lot of progress there!
- waffletower 3y agoNice to see Google researchers continuing to publish open papers with bonus demos. Won't beat a dead horse about Google failing to productize or open source their AI research.
- crazygringo 3y agoThis is so cool. Not earth-shattering or productivity-enhancing, but still really cool. I could definitely see this becoming a standard feature on desktop and phone wallpapers. Could also see it being applied selectively to photos in things like historical documentaries -- especially if it can handle the gentle movement of water and clouds as well.