I wonder if one alternate approach could perhaps be to do image segmentation on the original image, decide what segments are important enough to be preserved, a

I wonder if one alternate approach could perhaps be to do image segmentation on the original image, decide what segments are important enough to be preserved, and then, using other techniques to do the downscaling and color choosing, but while enforcing an additional constraint of sufficient contrast between the downscaled versions of the different segments? Like, if some detail would, if scaled down proportionally with everything else would become too small to make out, but where by making it a bit bigger than it should be would remain both recognizable, while still fitting ok within whatever larger thing? E.g. converting lips into a row of pixels when necessary. Similarly with eyes.