3 ms·

This is really incredible. Maybe a neat idea: artist draws/paints frames for animation, frames are converted into semi-photorealistic images through this softwa

This is really incredible. Maybe a neat idea: artist draws/paints frames for animation, frames are converted into semi-photorealistic images through this software, and assembled into a movie.

pdelbarba 10y ago
Welcome to HN... I wish they had a more samples of that. I'd be interested to see where the threshold is in terms of detail to get something vaguely photorealistic edit: in the other post there's a link to the paper with some good examples. I think the amount of detail you'd need would be pretty prohibitive in terms of artistic effort. On the other hand, it would be interesting to use this on something like a rough CG rendering to try to correct some of the shading imbalance and such.
rememberlenny 10y ago
I am a painter and did something similar. I took two images, one of nature and another of street art. Using style transfer, I combined a series of images. After identifying a few results that I liked, I used actual paint to make large canvases inspired by the digitally produced images. Link: https://twitter.com/rememberlenny/status/825026441603592193 https://twitter.com/rememberlenny/status/825026441603592193
deleted 10y ago
[deleted]
elihu 10y ago
I expect this is going to be the future of animation, since drawing in-between frames and backgrounds is very labor-intensive and expensive. It'll be interesting to watch how copyright law treats training data. Suppose I want to make an animation in the style of Disney or Studio Ghibli or Kyoto Animation, and so I use their entire body of work as training data to generate output in the same style from my own sketches. Is that now a derivative work? Is it different when a human copies a style while drawing by hand (requiring a degree of effort and skill that few possess) versus if a computer does most of the work (requiring low effort and ordinary artistic skills)? Would animation be treated any differently than, say, training an AI to write songs like Bob Dylan or write stories like J.R.R. Tolkien or host a radio show like Garrison Keillor?

This is really incredible. Maybe a neat idea: artist draws/paints frames for animation, frames are converted into semi-photorealistic images through this software, and assembled into a movie.

pdelbarba 10y ago

Welcome to HN... I wish they had a more samples of that. I'd be interested to see where the threshold is in terms of detail to get something vaguely photorealistic edit: in the other post there's a link to the paper with some good examples. I think the amount of detail you'd need would be pretty prohibitive in terms of artistic effort. On the other hand, it would be interesting to use this on something like a rough CG rendering to try to correct some of the shading imbalance and such.

rememberlenny 10y ago

I am a painter and did something similar. I took two images, one of nature and another of street art. Using style transfer, I combined a series of images. After identifying a few results that I liked, I used actual paint to make large canvases inspired by the digitally produced images. Link: https://twitter.com/rememberlenny/status/825026441603592193 https://twitter.com/rememberlenny/status/825026441603592193

deleted 10y ago

[deleted]

elihu 10y ago

I expect this is going to be the future of animation, since drawing in-between frames and backgrounds is very labor-intensive and expensive. It'll be interesting to watch how copyright law treats training data. Suppose I want to make an animation in the style of Disney or Studio Ghibli or Kyoto Animation, and so I use their entire body of work as training data to generate output in the same style from my own sketches. Is that now a derivative work? Is it different when a human copies a style while drawing by hand (requiring a degree of effort and skill that few possess) versus if a computer does most of the work (requiring low effort and ordinary artistic skills)? Would animation be treated any differently than, say, training an AI to write songs like Bob Dylan or write stories like J.R.R. Tolkien or host a radio show like Garrison Keillor?