7 ms·
Show HN: Neural network turns photos into a specific style of painting
- benologist 11y agoWill there be an API for this for digital-only, high resolution pics? Some feedback too: 1) when submitting it was a bit weird that I have to upload pics in order vs explicitly 'this is my pic', 'this is my art pic' 2) a lot of people won't have a catalog of digital art to upload as their reference pic, some samples to select from would be nice 3) after uploading my source + reference pics and clicking 'submit artwork' it takes me to a login/signup page for AMANUFACTORY.COM. That button really stands out as what-you-should-do to finish the process! 4) would be nice if instead of selecting one painting it generated lots of different styles
- chrischen 11y agoI hacked this in one day using some UI for existing stuff, so the UI will be a bit weird. After uploading your source + reference, you don't have to do anything. The Submit button at the bottom is UI for other people to submit a resulting image. I'll probably remove it since it's for the other stuff. As far as API, the process is fairly expensive (uses EC2 GPU instance), so any heavy application type usage would probably be better served by setting up your own instance. We use implementations found on github (credit at the bottom of the page).
- benologist 11y agoThanks for the info.
- dutchbrit 11y agoFunny, I hacked something like this together too recently, although it did take me a bit longer. Nice job!
- deleted 11y ago[deleted]
- bithive123 11y agoSee also: http://www.mrl.nyu.edu/projects/image-analogies/ http://www.mrl.nyu.edu/projects/image-analogies/
- arm55 11y agoI'd be really surprised if someone isn't already hard at work on an iOS app that uses this tech. The scalability is of course a problem, but I'd pay 50 cents per photo (assuming I got a small preview of it first) or something of that order to support the costs.
- chrischen 11y agoThere's no public list, so if you ran an image feel free to share here.
- anjc 11y agoQuick off the mark eh? When was this idea published by those researchers, two days ago? No wonder universities are getting super serious about IP protection/licensing/commercialisation
- dr_zoidberg 11y agoarxiv says it was submitted 26 Aug, so about a week ago. Near the end of the paper they explain how to implement it, so I guess it was a matter of reading the paper and sitting with caffe to toy/hack an implementation -- most of the heavy work was "already done". Edited some typos.
- gwern 11y agoI'm sure they're trying to patent it. (eg DeepMind has been patenting everything they can, even stuff like dropout and deep q-learning!) Which raises an interesting question: Instapainting is a commercial service and this is targeted at customers: > After your artwork is generated, you are free to use it for any purpose. Upload it to Instapainting.com as an order and an artist will physically hand-paint it! So how does that interact with the patent application? Are they liable for damages once the patents go through or do they just have to take it down?
- chrischen 11y agoWell that line is more like an advertisement for Instapainting. Instapainting doesn't run on this technology. That being said, a human artist can do a much better job than these algorithms!
- danieldk 11y agoInstapainting doesn't run on this technology. Aren't most convnets trained using dropout these days? Edit: it seems the implementation that this site uses does as well: https://github.com/kaishengtai/neuralart/blob/master/models/inception.lua#L75 https://github.com/kaishengtai/neuralart/blob/master/models/... Patents need to go :(.
- dharma1 11y agothat was quick, the paper just came out
- SomeDev15 11y agoWhat paper are you refering to? edit: Leon A. Gatys, Alexander S. Ecker, Matthias Bethge, A Neural Algorithm of Artistic Style
- deepnet 11y agoA Neural Algorithm of Artistic Style by Leon A. Gatys, Alexander S. Ecker, Matthias Bethge http://arxiv.org/abs/1508.06576 http://arxiv.org/abs/1508.06576
- nthitz 11y agoAnother take on it from Kyle McDonald https://medium.com/@kcimc/comparing-artificial-artists-7d889428fce4 https://medium.com/@kcimc/comparing-artificial-artists-7d889...
- chrischen 11y agoIn the process of switching to this implementation.
- chrischen 11y agoCan't switch until nvidia approves my CUDA account.
- sherjilozair 11y agoWhy do you need a CUDA account? You don't need one to install CUDA.
- danieldk 11y agoBut you do need one for cuDNN, which is not required for Caffe, but speeds it up.
- chrischen 11y agoYes getting out-of-memory issues without cudnn.
- Nanne 11y agoMight want to take a look at: https://github.com/jcjohnson/neural-style/issues/7 https://github.com/jcjohnson/neural-style/issues/7 Oh, and since you're basically using this commercially you might also want to take a look at the license of the VGG model: https://gist.github.com/ksimonyan/3785162f95cd2d5fee77#file-readme-md https://gist.github.com/ksimonyan/3785162f95cd2d5fee77#file-...
- siegecraft 11y agoI wonder what it looks like if you upload something cubist or otherwise abstract.
- chrischen 11y agohttps://www.instapainting.com/requests/view-asset/55e8a42290f1f848178b4569?asset=55e8a42290f1f848178b4569_aipainter.jpg https://www.instapainting.com/requests/view-asset/55e8a42290...
- siegecraft 11y agohttps://www.instapainting.com/requests/view-asset/55e7f37e90f1f8b87c8b4581?asset=55e7f37e90f1f8b87c8b4581_aipainter.jpg https://www.instapainting.com/requests/view-asset/55e7f37e90...
- chrischen 11y agoThe art style image should be the second image. So it tried to do the artwork in the style of the photo instead.
- zigggi 11y agocan we get a bigger version of the resulting image? The output is very small.
- chrischen 11y agoJust upgraded the implementation used. I'll see if I can increase the size without running into memory issues. EDIT: Increased to 768px max size.
- astrange 11y agoI accidentally submitted something four different times, since I thought the form wasn't loading. Does it just start as soon as you post two images, without a submit button?