3 ms·
It can only interpolate, not extrapolate. So the 'new' things you're seeing are just rearrangements of the (millions/billions of) things that the DNN was train
by blihp 4y ago
It can only interpolate, not extrapolate. So the 'new' things you're seeing are just rearrangements of the (millions/billions of) things that the DNN was trained on. It has no understanding of what it has 'learned' (or more accurately: lossy memorization a.k.a. compression) and makes all kinds of mistakes (some due to training losses, some due to garbage/conflicting data fed in.) This is probably why the creative applications (i.e. Stable Diffusion etc) seem more impressive than the functional applications (i.e. Galactica) as even 'wrong' output can be creatively interesting.
For example, if a new comic/movie/video game character came out tomorrow that had a very unique physical look, Stable Diffusion would have difficulty even approximating it (i.e. its training data wouldn't have what was needed to reproduce the appearance.) But it can produce a decent Darth Vader because it's probably been fed at least thousands of drawings/photos of this very well known fictional character.
- Filligree 4y agoYou need about ten pictures for Dreambooth to give Stable Diffusion a good idea of what a new character looks like.
- krackers 4y agoThat's like saying the novels people write are just rearrangements of words we learned as a kid. I don't see how you can't possibly consider something like this [1] as extrapolation and genuine creation. [1] https://twitter.com/pic/orig/media%2FFi4HMw9WQAA3j-m.jpg https://twitter.com/pic/orig/media%2FFi4HMw9WQAA3j-m.jpg
- renewiltord 4y agolink broken
- krackers 4y agoSorry, try https://pbs.twimg.com/media/Fi4HMw9WQAA3j-m.jpg https://pbs.twimg.com/media/Fi4HMw9WQAA3j-m.jpg Source: https://twitter.com/typedfemale/status/1598222844902936578 https://twitter.com/typedfemale/status/1598222844902936578
- visarga 4y agoExactly, interpolation in combinatorial space becomes extrapolation.
- seydor 4y agoextrapolation is interpolation between things that haven't been interpolated before, so i wouldnt be so sure about it. Its objective is not to go after unfamiliar routes, but it can be trained to do so