9 ms·
MagicEdit: High-fidelity temporally coherent video editing
- thatguy27 3y agoNo code...
- deleted 3y ago[deleted]
- chankstein38 3y agoRight? I clicked on the "Code" link expecting code and found code for the project presentation page basically. The paper seems cool but also looks like something that'd take me a while to implement and I don't really have time right now.
- cdchn 3y agoAll of the source videos that have people's faces seem to be blurred. Are they blurred before transforming or do they blur it just to post the samples on their web page?
- AbrahamParangi 3y agoThe latter, presumably they didn't ask.
- bob_theslob646 3y agoWait what?
- deleted 3y ago[deleted]
- htrp 3y agoLooks like its building on the same concepts as stable video. https://github.com/rese1f/StableVideo https://github.com/rese1f/StableVideo
- capableweb 3y agoInteresting enough ByteDance (TikTok/Douyin) seems to be behind it.
- xnx 3y agoComing soon to TikTok filters (if it doesn't already play a role in some of them)
- ipsum2 3y agoByteDance does a lot of ML research on music/video.
- danielbln 3y agoTheir video editor CapCut is really good.
- simlevesque 3y agoTheir multi-object tracker ByteTrack is also one of the best available.
- Timon3 3y agoIt's crazy how consistent the Shutterstock logo is in the outpainted examples.
- deleted 3y ago[deleted]
- jjcm 3y agoSeems like it's reversed along the Y axis as well? I'm curious what led to that. The nefarious side of my brain say it was a very basic attempt at making the source training data less immediately recognizable in any generated output, but I do wonder if there's a more innocent explanation.
- gs17 3y agoA "more innocent explanation" could simply be data augmentation. It seems pretty clear they don't care that it's obviously using watermarked Shutterstock videos.
- satvikpendem 3y agoImagine in 5-10 years where, just like people make video games all by themselves or with a small group of people, people can make their own movies that rival Hollywood productions, for a fraction of the cost as there's no need to hire anyone. When the output is just pixels on a screen and you can manipulate the placement of every pixel, it's really no different to Hollywood making them with real actors and crew members or someone drawing them, as is the case with current animation methods. Now, we can do the same process as drawing each frame but then make it look photorealistic.
- ChatGTP 3y agoWatching you own movie sounds quite boring ? Spoiler alert ?
- dylan604 3y agoEven in animation, there are teams of people involved. Each team specializing in different aspects. This single person hollywood replacement dream is something to be really afraid of, at least as far as the quality of the content. I couldn't imagine watching something that only one person has ever worked on with no input from other people with suggestions/tweaks/edits to improve the product. We've already seen things like True Detective Season 2 that was produced and it had people involved that did not push back.
- satvikpendem 3y agoI played Stardew Valley, a game made entirely by one person, and by all accounts it is one of the highest rated games of all time. Can anyone make shit? Sure, that is true in any medium. But individuals or even small groups of people can do amazing things, if they have the tools. It is not "something to be really afraid of," which I find to be an extremely hyperbolic view.
- dylan604 3y agoHave you seen The Room? Anytime I see the same person's name in the credits for all the roles, I immediately start to get nervous. Also, small teams is not a single person
- dylan604 3y agowhat would happen if they didn't say "pretty girl"?
- deleted 3y ago[deleted]
- pridkett 3y agoI’m disappointed that all of their examples of humans are “a pretty girl”. Yeah, I get that people use generative models for that, but there’s a lot more you can do.
- phren0logy 3y agoThey seem to have thrown a few "handsome man" examples in there, too.
- dylan604 3y agoThat's not the point though. To me, it reeks of a bunch of dude bros. I'm guessing they can't say "a hot chick" otherwise the LLM would show a baby chicken on fire or at least sweating in front of a fan??? Does "hot chick" even translate to Chinese well? It's the fact that they felt the need to use "pretty" instead of just "girl" or young woman.
- deleted 3y ago[deleted]
- aantix 3y ago[flagged]
- brink 3y agoKendrick Lamar: "I'm so sick and tired of the Photoshop" Who actually wants to look at this? It's a neat trick, but I greatly prefer to look at what's real, and I imagine most people outside of this AI hype bubble do too. It's implied that the stable diffusion here is making the video better, but by most definitions of the word "better", it's not.
- jtriangle 3y agoPorn man, they're going to use it for porn, alot of porn, like, a gigantic shitload of porn, things you can't even imagine. Things have been spiraling around the drain for years now, remove the 'people' aspect of it, and you now have something where a large number of people's objections to it are completely removed. The studios stand to make more money, because there's no actors/crews/locations/etc to pay, and they don't have to deal with any of the management associated with those things as well. Don't get me wrong, there's plenty of research to suggest that porn consumption is absolutely terrible for your mental health, but without the "that poor woman" ex-pornstar to sit on daytime TV and talk about the horrors they experienced, it's not likely to go much further in terms of regulation, which is going to make sure this sort of tech gets adopted there first. It'll absolutely get rolled out into hollywood eventually, it's just that there's so much infrastructure in place to already do everything this does, I can't imagine much will change all that quickly.
- xnx 3y agoThis looks like a nice improvement on current video to video techniques: https://stable-diffusion-art.com/video-to-video/ https://stable-diffusion-art.com/video-to-video/
- jdprgm 3y agoI have been reading a lot of adjacent papers to this recently. Here is a useful collection for anyone interested: https://github.com/zengyh1900/Awesome-Image-Inpainting https://github.com/zengyh1900/Awesome-Image-Inpainting I have noticed an overwhelming trend that the vast majority of authors tend to be Chinese sounding names even when associated with an US based university. Obviously some of those could be Americans as well but it stood out to such a degree I was curious if anyone had any insight. Also if there is code (this projects links to github but it's empty), it tends to be basically abandonware once these papers are published with no effort towards commercializing or turning into healthy open source projects for some reason.
- archibaldJ 3y agothis is the no-code future all those platforms like retool, airtable, etc, had been talking about
- justinator 3y ago"a pretty girl, white singlet, dark pants, on the stage" Well, glad they kept the 6 fingers on her right hand.
- deleted 3y ago[deleted]
- groceryheist 3y ago[flagged]
- shantnutiwari 3y agoWhen I click on the code link, there is no code, just the same images and an assets folder with 1 gif file. Why is this even on HN? There are zero details of how its built, or what the source looks like. Am I missing something?
- hnben 3y agothere is a link to the paper (https://arxiv.org/abs/2308.14749 https://arxiv.org/abs/2308.14749)
- pindab0ter 3y agoSite doesn't work correctly for me on Edge. Every row has at least one disappear after a fraction of a second when loading the page.