4 ms·
There has been other recent work (Preserving Color in Neural Artistic Style Transfer) that allowed control, separate from the "style", over how much of the orig
by webmaven 10y ago
There has been other recent work (Preserving Color in Neural Artistic Style Transfer) that allowed control, separate from the "style", over how much of the original painting's color palette to use:
https://arxiv.org/pdf/1606.05897v1.pdf https://arxiv.org/pdf/1606.05897v1.pdf
It isn't too hard to extrapolate from this to using separate images as sources for the style and palette, and from there to transforming the "content" image's color palette to resemble the palette of the "style" image in terms of saturation, value, contrast, etc. (but not hue) by manipulating histograms, and then using that result instead of either the "content" image's or the "style" image's palettes.
Because if you have a photo of a bright red cardinal and a desaturated pastel drawing of a pale blue boat, the result you are likely to be most pleased with would be a pastel cardinal that is, well, pink, and not a pale blue cardinal.
Of course, the harder version of this would need to recognize the semantics of both the "content" and the "style" image in order to construct a more meaningful palette to be applied (which is what you're getting at), and that same semantic information will also help with transferring the style more meaningfully (eg. crude palette-knife houses in the background but small brushed strokes depicting the people in the foreground).