8 ms·
Style2Paints: AI colorization of images
- CardenB 9y agoTitle is a little misleading. This is AI colorization of drawings, not all images.
- BugsJustFindMe 9y agohashtag.
- em3rgent0rdr 9y agobut not simply drawings. Rather only uncolored outlined ones.
- IanCal 9y agoIf you want to be pedantic about it, it does work do colourisation of all images, it's just not as good as it is with sketches. https://imgur.com/a/jXIhx https://imgur.com/a/jXIhx
- Mithaldu 9y agoNope, images: https://i.imgur.com/QkFDOVs.png https://i.imgur.com/QkFDOVs.png
- PrunJuice 9y agoIf it's a shame that the brightest minds of our generation are working on UIs and advertising, what does that make this? (:
- awesomepantsm 9y agoThis is the result of the brightest minds working on advertising. Who do you think made TensorFlow? Hint: it was Google.
- mistercow 9y agoI think there's a legitimate point to be made that it's a shame that the best way we've found to coordinate our resources to advance science and technology is capitalism. It's not like capitalism doesn't work, but if you envision a sort of "coordination oracle" which divides up resources ideally, and which everyone magically trusts, it seems pretty obvious that we would be advancing much more quickly. But I also agree that there's not much point in dwelling on that point. So far, finding ways to leverage capitalism into solving problems has tended to be a lot more fruitful than looking for a replacement.
- Jack000 9y agoCapitalism = greedy optimization with a Bayesian assumption. It tends to get stuck in local maxima and does weird things when the inputs are biased, but otherwise works ok. There are almost certainly better ways to search the solution space, but most serious attempts attempts thus far have been non-sensical or impractical.
- deleted 9y ago[deleted]
- Houshalter 9y agoNo one objects that capitalism isn't a good optimization processes. Just that it's optimizing the wrong utility function. At one point something like 50% of STEM majors at MIT went to work on wall street. And the ones that don't go there go to work making more efficient targeted advertisements or addictive smartphone games or other unethical shit. Our population has a limited number of "smart people". I don't think any alien looking in from the outside, would think we are allocating them even remotely efficiently. It would be pretty difficult to design a system that does worse than ours on this aspect. The solution isn't necessarily communism, but perhaps a hybrid. E.g. the government funds things capitalism has no incentive to optimize for, like scientific research.
- Jack000 9y ago
- Jack000 9y agoany more info on the architecture? Looks like it might be a cgan.
- mrmondo 9y agoMay I suggest that using creepy sketches of young girls may not be the best example if you want people to take your software seriously?
- imaginenore 9y agoWhat's creepy about them?
- amelius 9y agoI suppose the images look creepy because of the combination of young age with poses and looks that are not usually associated with girls of such young age.
- anon203597 9y agoYes, let's apply cultural standards universally, surely this will make the world a better place. At least professional artists know how to avoid offending anyone's tastes. https://commons.wikimedia.org/wiki/File:William-Adolphe_Bouguereau_(1825-1905)_-_Admiration_(1897).jpg https://commons.wikimedia.org/wiki/File:William-Adolphe_Boug...
- mrmondo 9y agoThe painting you have used as a reference point of cultural standards is not a current style of art that is widely practised or recognised as ‘normal’.
- amelius 9y agoPerhaps the painting you referenced was meant to evoke disgust, or feelings of guilty pleasure. Imho, both are not really appropriate on a project page especially if used excessively and without reason. At least the child in your painting looks naturally shy, given the situation. This in contrast to the cartoons, where the child seems to be taking the lead in seduction. Why ascribe feelings to children which they don't have?
- 9y ago
- IanCal 9y agoSurprisingly good results!
- bencollier49 9y agoI was thinking of trying it on something less Anime, and then noticed that another poster didn't like the original poster's subject-matter, so I ran it on this: https://imgur.com/a/z00jG https://imgur.com/a/z00jG Not bad? I guess?
- Mithaldu 9y agoHm, i wouldn't say that's usefully different from anime? The failure mode for e.g. pencil sketches is honestly kind of impressive. https://i.imgur.com/vdceynO.png https://i.imgur.com/vdceynO.png https://i.imgur.com/2lvrpwE.png https://i.imgur.com/2lvrpwE.png On the other hand: https://i.imgur.com/QkFDOVs.png https://i.imgur.com/QkFDOVs.png Edit: Also, i missed this earlier, but this video shows nicely how the AI can be guided with color hints: https://www.bilibili.com/video/av14443094/ https://www.bilibili.com/video/av14443094/
- myrryr 9y agoThis is amazing. Do you think it would be possible to keep the coloring constant across an animation? If so, you will certainly have a market for this. The coloring work in animation take a lot of time and is very expensive.
- anon203597 9y agoSimilar work on art style transfer usually has yielded somewhat surreal shifting results when they applied it to videos even after adding some logic that stabilized things from frame to frame. Plus this is far from perfect, it works best if you provide a lot of hinting and even then it produces results that may look pleasing enough but are not really close to what one has intended for a particular character design. I would guess that it can be made good enough for some novelty videos but it's still far from professional production quality.
- julius 9y agoInteresting. It would be amazing if you could find the time, to elaborate, share some insights into this industry. Specifically: What are 2-3 major companies that would profit? How does the current process work; do they make an entire uncolored scene and then color it? What do I have to google, to find example videos of uncolored animation? Can you ballpark how much it costs to color a 30min TV-Episode?
- anon203597 9y ago> What do I have to google, to find example videos of uncolored animation? key animation, genga (原画) uncolored: https://sakugabooru.com/post/show/23064 https://sakugabooru.com/post/show/23064 finished: https://sakugabooru.com/post/show/23126 https://sakugabooru.com/post/show/23126 > How does the current process work; This depends a lot on the production process used. These days it's anything between hand drawn frames with digital coloring to completely digital processes using 2D vector graphics or 3D models.
- avian 9y agoI tried Style2Paints on a simple animation I did a while back. No manual color hints. I just played a bit with the references and settings in the web interface and used the provided models. The input were uncolored outlines. Considering it has very little in common with the anime training set I think it looks promising. https://www.youtube.com/watch?v=PZixy1cXQPE https://www.youtube.com/watch?v=PZixy1cXQPE
- artur_makly 9y agois there any direct way to contact the developer(s) ? i cant read chinese
- gwern 9y agohttps://www.reddit.com/r/MachineLearning/comments/72l4oi/pfinally_managed_to_paint_on_anime_sketch_with/ https://www.reddit.com/r/MachineLearning/comments/72l4oi/pfi...
- diyseguy 9y agoThis would be so great as some kind of Gimp filter plugin