4 ms·

I suspect it is designed to describe images, like you would find in alt text but run in reverse. As your first example is closer to English it can do a better j

by rhdunn 4y ago

I suspect it is designed to describe images, like you would find in alt text but run in reverse. As your first example is closer to English it can do a better job than with the second example, like how the Jabberwocky poem contains nonsense words but still makes some degree of sense. For example, the "yon" is immediately reconizable to me (hither and yon), so "yon corpti" could mean a distant corpti (whatever a corpti is). "becross" looks similar to "across" but with a be- prefix (be-tween, be-neath, be-twixt, etc.), so could be an archaic form of that. "chronly" could be something time related (chronos+ly). etc...

gojomo 4y ago
Indeed - the 'cadence of English' prompt reminds me of Latin, or some other foreign-litany that's nonetheless repeated to an audience that's not following every word. And ~IIAOPSW has used real word-roots, hinting at meanings! (The FastText algorithm does a passable job at synthesizing word-vectors for unknown words using such fragments.) So rendering that as a religious scene isn't too surprising. That morse code gives nothing useful probably just indicates some combination of – (a) few morse transcripts in training set; (b) punctuation-handling in training or prompting – makes it more opaque. It's opaque to me, other than recognizing it's morse code.
- IIAOPSW 4y ago
  I accidentally omitted a sentence. I tested it on DallE mini as well. It also behaved consistently there, but that version gave me mostly Beetles with a few bike races mixed in. I also played slightly with the nonsense words to see if perhaps something I picked was too close to a real word. The revised prompt gave me doctors on DallE mini and letter tiles / notebook pages in DallE, with the mini-version producing two noteworthy images that exhibit the "name one thing in this photo" effect. https://i.dailymail.co.uk/1s/2019/04/25/14/12707994-6959547-image-m-36_1556198258556.jpg https://i.dailymail.co.uk/1s/2019/04/25/14/12707994-6959547-...
  - gojomo 4y ago
    I'm not particularly surprised that official DALL-E & unofficial DallE-Mini went different directions with the same input, as they're different-sized models with different training sets. Below a certain level of complexity, perhaps only "vaguely like beetle or bicycle/race names" arbitrarily survived all the other competing influences on the model's internal weights. Above, much more subtle patterns – like many more latinate word roots – might start to survive. Compare also what I linked in another thread branch – https://twitter.com/gojomo/status/1540095089615089665 https://twitter.com/gojomo/status/1540095089615089665 – where simply growing the size of a similar (non-public Google PARTI) model leads to a phase-change in its ability to render meaningful human text.

by rhdunn 4y ago

gojomo 4y ago

Indeed - the 'cadence of English' prompt reminds me of Latin, or some other foreign-litany that's nonetheless repeated to an audience that's not following every word. And ~IIAOPSW has used real word-roots, hinting at meanings! (The FastText algorithm does a passable job at synthesizing word-vectors for unknown words using such fragments.) So rendering that as a religious scene isn't too surprising. That morse code gives nothing useful probably just indicates some combination of – (a) few morse transcripts in training set; (b) punctuation-handling in training or prompting – makes it more opaque. It's opaque to me, other than recognizing it's morse code.

IIAOPSW 4y ago
I accidentally omitted a sentence. I tested it on DallE mini as well. It also behaved consistently there, but that version gave me mostly Beetles with a few bike races mixed in. I also played slightly with the nonsense words to see if perhaps something I picked was too close to a real word. The revised prompt gave me doctors on DallE mini and letter tiles / notebook pages in DallE, with the mini-version producing two noteworthy images that exhibit the "name one thing in this photo" effect. https://i.dailymail.co.uk/1s/2019/04/25/14/12707994-6959547-image-m-36_1556198258556.jpg https://i.dailymail.co.uk/1s/2019/04/25/14/12707994-6959547-...
- gojomo 4y ago
  I'm not particularly surprised that official DALL-E & unofficial DallE-Mini went different directions with the same input, as they're different-sized models with different training sets. Below a certain level of complexity, perhaps only "vaguely like beetle or bicycle/race names" arbitrarily survived all the other competing influences on the model's internal weights. Above, much more subtle patterns – like many more latinate word roots – might start to survive. Compare also what I linked in another thread branch – https://twitter.com/gojomo/status/1540095089615089665 https://twitter.com/gojomo/status/1540095089615089665 – where simply growing the size of a similar (non-public Google PARTI) model leads to a phase-change in its ability to render meaningful human text.