3 ms·
We don't disagree at all about what DallE does or what I would expect to see on certain outputs. What I'm saying is maybe that output is actually correct and we
by IIAOPSW 4y ago
We don't disagree at all about what DallE does or what I would expect to see on certain outputs. What I'm saying is maybe that output is actually correct and we just don't know it yet. Maybe the brain really does encode some amount of information on just the sound fragments. Maybe vocabulary words aren't wholly arbitrary signifiers but instead come from some deeper system our brain uses to encode things. There is already a known human version of consistent output given nonsense words. Its called Bouba and Kiki.
https://en.wikipedia.org/wiki/Bouba/kiki_effect https://en.wikipedia.org/wiki/Bouba/kiki_effect
There's other evidence in support of this idea, but it would be a hassle for me to dig it up now.
>Your first random prompt is far from random. It contains the fragments "sublim", "chr", "cross" and "corpt" in addition to the isolated "E", which all project the solution down towards Latin and Christianity.
Oh right, I omitted a sentence. DallE gave me churches. DallE-mini gave me bicycle racing and beetles. Both of them behaved self-consistently, but were not consistent with each other. I did test changing some of the words that seemed like they might be having the steering effects like you pointed out. The new phrase was "E sublumary widge fraus chronly non estoi". DallE mini gave me mostly doctors/medical procedures with a few indiscernible scenes mixed in. Real DallE gave me scrabble, word tiles, pages from a book.
Its like this. If you talk to a dog with the "who's a good boy" voice, the dog will understand "who's a good boy", even if you're actually saying "who's a little asshole". Likewise, a pronounceable string will generally feel like it belongs within a certain envelope of meanings, even if its not actually a phrase in any real spoken language.
I showed some maps that DallE generated which happened to have some places labelled with its usual gibberish. People said the place names felt vaguely like they might be in Eastern Europe. Interpretation of nonsense words works both in the direction of human to DallE and DallE to human!