3 ms·
AI art is also currently cliched in an anti-novelty way. High-level image composition and low-level style are based on the training set and while you can mix an
by barrkel 4y ago
AI art is also currently cliched in an anti-novelty way. High-level image composition and low-level style are based on the training set and while you can mix and match and tween between different points in the latent space, genuinely novel stuff doesn't come out; you're stuck within a bounded space. They're kaleidoscopes of kitsch. If you want a seven legged demon with three faces all around its head, a monster that doesn't exist and hasn't been drawn in lots of poses in extant art, you can't reach it with prompts.
There's also a "terrain" in the latent space, with valleys of popularity and mountain ranges of novel intersections. Generated images can flip from one valley to the other with a small change in prompt, and it's hard to stay in the intersection. Fine tuning helps alter this terrain - that's mostly what fine tuning does. Rather than teaching genuinely new things, it mostly warps and tweaks what's already there to make it easier to target, at the cost of making everything else a tiny bit harder to get to. Teaching the model new things requires including lots of regularization images to ensure it doesn't forget all the other stuff, which is more expensive than fine tuning or dreambooth.
- wincy 4y agoI like your mental model here, I’ve described it to friends as it feels like beach combing looking for the perfect seashell. I have a vague idea of where to go to find nice pictures through prompts but am not totally sure what I’ll find when I get there, a lot of them are weird and broken, but some can be cleaned up, polished and look really nice. I can’t really affect what comes out of the “ocean”, though, like you said.