5 ms·
VQGAN+CLIP seem to have this dream-like quality where they generate images that are evocative of your prompts but don't actually picture them. I find it fascin
by kaoD 5y ago
VQGAN+CLIP seem to have this dream-like quality where they generate images that are evocative of your prompts but don't actually picture them.
I find it fascinating because in some cases it's not as obvious as "lump of white fluffy matter" = "sheep" but it still manages to evoke the prompt into our brains.
I'll sometimes get an unrecognizable blob but quickly asking my SO "what is this?" she will get it... unless she consciously looks at it!
Fascinating.
- deleted 5y ago[deleted]
- meowface 5y ago>quickly asking my SO "what is this?" she will get it... unless she consciously looks at it! It does make you wonder about hypothetical artificial neural network-like "subconscious" layers and how "more conscious" prefrontal cortex layers potentially adjust predictions and perceptions based on their inputs. (Probably a convenient "just-so" "clockwork universe"-esque narrative unsupported by neuroscience research, though.)
- kortex 5y agoIt's definitely "injective but not bijective" or something like that. Like I look at the prompt "sheep grazing on a hillside by tim burton". I look at the pic. Brain goes, "yup, that checks out". You wouldn't necessarily derive the domain from the range (preimage attack), but I can readily say, "if I fell asleep after watching Wallace and Gromit - Close Shave, and Nightmare Before Christmas, this is what I would dream".
- bentcorner 5y agoGAN Theft Auto also had a similar dream-like quality, especially with anything involving collisions (cars and how "big" the road was). https://www.youtube.com/watch?v=udPY5rQVoW0 https://www.youtube.com/watch?v=udPY5rQVoW0