3 ms·
I'm not particularly surprised that official DALL-E & unofficial DallE-Mini went different directions with the same input, as they're different-sized models wit
by gojomo 4y ago
I'm not particularly surprised that official DALL-E & unofficial DallE-Mini went different directions with the same input, as they're different-sized models with different training sets.
Below a certain level of complexity, perhaps only "vaguely like beetle or bicycle/race names" arbitrarily survived all the other competing influences on the model's internal weights. Above, much more subtle patterns – like many more latinate word roots – might start to survive.
Compare also what I linked in another thread branch – https://twitter.com/gojomo/status/1540095089615089665 https://twitter.com/gojomo/status/1540095089615089665 – where simply growing the size of a similar (non-public Google PARTI) model leads to a phase-change in its ability to render meaningful human text.