5 ms·
(Author here.) For details, the research paper is linked on the GitHub page: http://arxiv.org/abs/1603.01768 http://arxiv.org/abs/1603.01768 For a video and h
by nuclai 11y ago
(Author here.)
For details, the research paper is linked on the GitHub page: http://arxiv.org/abs/1603.01768 http://arxiv.org/abs/1603.01768
For a video and higher-level overview see my article from yesterday: http://nucl.ai/blog/neural-doodles/ http://nucl.ai/blog/neural-doodles/
Questions welcome!
- ThePhysicist 11y agoYou should make an app for that (seriously)!
- option_greek 11y agoOr an online generator!
- Untit1ed 11y agoI can't believe he posted it up on github before doing this - there's so much potential for this to go viral once it's packaged with a doodling app. EDIT: Actually reading more closely I guess 10 minutes on a machine with a decent GPU is a lot of server load :|.
- nuclai 11y agoThe research is based on work I did writing and improving @DeepForger (http://twitter.com/deepforger http://twitter.com/deepforger), an online service for "basic" style transfer. The GitHub is a standalone version for learning and education, which doesn't do HD rendering as well yet and uses a bit more memory. The positive side, however, is that opening up the source code makes these ideas progress faster! We'll try to integrate the idea of semantic style transfer into @DeepForger in the future, but this require quite a bit of work to get it to reliably understand portraits or landscapes without anyone's intervention. The fact it does require these semantic maps for all images makes it less straightforward to release as a service.
- TuringTest 11y agoOne question, is the semantic map created on the fly at the same time as the final image is composed, or are the maps pre-computed?
- nuclai 11y agoThe semantic map remains static during the optimization, so it can be provided as a pre-computation (e.g. pixel labeling, semantic segmentation, etc.) or done by hand. The ones in the repository are done manually, but now experimenting with other algorithms. Anything that returns a bitfield or masks can be used!
- mozumder 11y agoWhy CUDA instead of OpenCL? Asking because I'm about to start a GPU compute driven project.
- nuclai 11y agoAlmost nobody in deep learning uses OpenCL. All the DL frameworks primarily focus on CUDA and that's where you get the best performance. OpenCL is off the beaten path and you pay for it in every way: support, performance, reliability. AMD is going to support CUDA somehow too, I think that's a sign they admitted defeat on OpenCL for this.