3 ms·
So I've been playing with style transfer for about six months. I even combined it with another technique to actually get something that I liked enough to have p
by j2kun 10y ago
So I've been playing with style transfer for about six months. I even combined it with another technique to actually get something that I liked enough to have printed on canvas (https://github.com/j2kun/art-21-logo https://github.com/j2kun/art-21-logo)
And as much as I love the math, the computer science, and the tech behind it, I have to admit that the novelty wore off quick. Not only does a style-transferred image not have the power of the original, as another commenter said (we can debate about why), but the longer you look at it the more you see the ugly artefacts. I understand it's not perfect, and that there will be improvements, but to me that's what's primarily holding back style transfer. Not runtime or memory constraints, but whatever first principles need to change to get a global unity of style in the image.
Of course, if you introduce the human hand to fix the artefacts (which I think is great, and I know people are working on this), then style transfer can still be super useful. I can definitely see this becoming a new photoshop/illustrator integration.
- eppeltert 10y agoDid you try putting more structure (concentric outlines or a gradient or something) in the input image? Seems like style transfer would fall flat on a binary image.
- pierrec 10y agoGradients in the source image tend to yield poor results. They often awkwardly reappear in the result, looking like an artifact doesn't fit with the style image at all. Source images in a posterized style, with large flat surfaces in unified colors, tend to yield great results with few artifacts. With that in mind, I find the raw "21" logo to be a rather good source image. Two colors is minimalist, but it's a choice. I'm sure GP went for simplicity quite deliberately.
- j2kun 10y agoDefinitely the original is good, too, and my example was a fun addition, not a replacement of the original logo :)
- sprobertson 10y agoGood to see more people with neural images on their wall, here are some hand painted: https://i.imgur.com/6nOllzf.jpg https://i.imgur.com/6nOllzf.jpg