3 ms·
Wow, so this is fascinating. Some observations: - Many of the frames look like someone just applied a "sharpen" filter -- there's (as expected) no real new inf
by crazygringo 8y ago
Wow, so this is fascinating. Some observations:
- Many of the frames look like someone just applied a "sharpen" filter -- there's (as expected) no real new information, it's just sharper... so it doesn't seem like a big deal, like I could do it in Photoshop trivially
- But then there are a few spots where new details are truly seamlessly added... the fireball in the spaceship explosion, and forehead wrinkles. Stunning, they're absolutely seamless and believable, with detail that is simply not there in the original... that's literally magic
- But at the same time, characters in the background that are slightly out-of-focus get oversharpened when they're supposed to be blurry, like it can't tell when moderate blurriness is due to resolution or focus
Overall, I'm pretty shocked that the effect is so seamless across frames -- I totally would have expected this to produce weird discontinuities in time, but I didn't see any at all. I mean, this actually seems like it's already production-ready to throw into TV's or VLC. Which is crazy.
I wonder how much of this is "general-purpose", or to what extent this works on this episode because it's trained on this episode? E.g. the neural network is learning from a close-up of the Ferengi face or spaceship, to apply specifically to a later smaller version. Or to what extent this will work well across TV shows, across actors, across genres, without prior training, or with sparse training?
- ch_sm 8y agoHe’s using an off-the-shelf commercial app called "AI Gigapixel", which in turn uses a process called image super-resolution. It is general purpose (works for all kinds of images) and fairly thoroughly explored by now. hope this helps