5 ms·
The aspect of ai that makes me think something related is going on, is how artifacts look in image generation systems like stable diffusion. Often these system
by bawolff 4y ago
The aspect of ai that makes me think something related is going on, is how artifacts look in image generation systems like stable diffusion.
Often these systems will have really bizzare artificats, people with 3 arms, etc. However at the same time when you glance at the output without looking carefully you will sometimes miss these artifacts even though they should be absolutely glaring.
- RosanaAnaDana 4y agoI think anyone who has tripped would also commiserate. Seeing too many eyes or fingers at a glance. Things feeling cartoony or 'shiny'. I don't know if AGI is down the road diffusion models have taken us. I'm not even really sure what most people mean by AI when they talk about it. But stable diffusion et al are clearly super human. I'm not sure that AGI is down the trail cut by diffusion models, but if it's ever accomplished, these models will almost assuredly represwbt some of the learnings required to get there.
- sebmellen 4y agoSeeing my hand covered in eyes while tripping completely changed my view of the mechanisms behind sight. Something that had previously seemed so “real” and deterministic suddenly was no longer; the interpretation layer was momentarily unveiled.
- merely-unlikely 4y agoMy pet (uneducated) theory is that AI needs to have a parent layer "consciousness" before it can become an AGI. Think of that voice inside your head and your ability to control bodily functions without needing to do it all the time. My model is our brains have many specialized "sub AIs" operating all the time (remembering to breathe for example) but then the AI behind the voice can come in and give commands that override the lower level AIs. What you think of as "me" is really just that top level AI but the whole system is needed to achieve general intelligence. Sort of like a company with many levels of employees serving different functions and a CEO to direct the whole thing, provide goals, modify components, and otherwise use discretion.
- idiotsecant 4y agoDo I contradict myself? Very well then I contradict myself, (I am large, I contain multitudes.)
- grantcas 4y ago[dead]
- ben_w 4y agoFor me, it's the way generative videos can rapidly, but to my eyes seamlessly, transition from one shape to another. I may not be able to record my dreams, but my memories of my dreams do match this effect, with one place or person suddenly becoming another.
- Galaxeblaffer 4y agoIt's very similar to strong trips on psychedelics.
- Waterluvian 4y agoYes! I’m confident this isn’t an original thought, but I feel like it’s a dream generator. Things that aren’t quite right but are in some way, perfectly contextually and topologically valid. Like it’s tricking the object classifier in my brain with a totally unrealistic thing that my brain is ready to simply accept. There’s some image I see on occasion that’s 100% garbage. If you focus on it you cannot make out a single thing. But if you glance at it or see it scaled down, it looks like a table full of stuff.
- cameronh90 4y agoCheck out the Velocopedia project for something else along this line of thinking: http://www.gianlucagimini.it/prototypes/velocipedia.html http://www.gianlucagimini.it/prototypes/velocipedia.html Turns out nobody quite knows how to draw a bicycle. They get the gist but the details don't make sense.
- deleted 4y ago[deleted]
- jasonwatkinspdx 4y agoWhile there's definitely a similarity it's also important not to over generalize. For example the human vision system and stable diffusion may end up using similar feature decomposition, but that doesn't mean the rest of the brain works anything like that. I strongly suspect that if we do ever fully map the "architecture" of the brain, the result will be a massive graph that's not readily understandable by humans directly. This is already the case in biology. We'll end up with a computational artifact that'll help us understand cause and effect in the brain, but it'll be nothing like a tidy diagram of tensor operations like in state of the art ML papers.
- ffwd 4y agoNot sure if I'm missing a subtle nuance in your point but to me those "artifacts" are completely expected. Those artifacts like 3 arms are the patterns / outputs in the model, but since it doesn't have a fundamental understanding of the patterns/objects like arms, it just blends many images of arms together and create things like 3 arms. Also why there are so many eyes, arms, legs and other things in other generative programs. It just spits out the training set in random configurations (ish). I suspect also the reason the images look OK at a glance is because the images as a whole also represent patterns in the model so they actually come from "real life" / artist created images and thus have some sense of cohesion. But making the AI have all the right patterns so it never makes a mistake at all scales of the image while also being able to combine the pattern with real understanding of what they are conceptually is the real trick but until then it will be a "salad bowl collage" thing at random intervals. The closest thing to the brain it looks like to me is simply the hierarchical nature of it which seems similar to v1/v2/the vision system in humans but I've only been told that, I'm no neuroscientist.
- l33tman 4y ago"It just spits out the training set in random configurations (ish)." is a pretty gross misrepresentation and oversimplification of how such a model works, akin to saying a human artist only spits out whatever they saw earlier in their life in random configurations, or saying that SD only spits out pixel values it has seen before, or combinations of pixel values that form edges, etc. FWIW I don't think there is anything particularly wrong in the model architectures or training data that in some fundamental way makes it impossible to always get 2 arms. After all, lots of other tricky things are almost always correct. I suspect it's a question of training time and model size mostly (not trivial of course as it's still expensive to re-train to check modified architectures etc). It's also a matter of diffusion sampling iterations and choice of sampler at inference time, for the case of SD.
- ffwd 4y agoI get your point, but I also think it depends on what you mean by oversimplification. Of course there is _a lot_ of stuff going on and things like SD capture all kinds of information, not just what I described, however, any way you want to describe it, capturing all the "constraints" and real life knowledge to perfectly create realistic images with all the details and all the higher abstractions correctly is not anywhere close I think. Also it's not only to always get 2 arms, it's to - at the same time - also get 2 ears, 2 eyes, perfect pupils, perfect fingers, perfect trees, perfect chairs, all simultaneously (if it is to be used at least in the mainstream) - etc you get my point. I also don't think there's anything wrong with the model architectures in themselves or the data, nor that it is impossible, only that it is hard and as you say I think it needs a lot of data and clever engineering to fix mistakes. It may even be possible to fix most mistakes, over time, which would be pretty impressive imo, but the absolute limits of what a model can produce/"contain" with our hardware is kind of an open question though interesting.
- vharuck 4y agoBut wouldn't the people creating these models and deciding whether to publish them prefer ones with these "understandable" mistakes? There might have been other ones that had equal potential as far the evaluation measure goes, but humans had been involved all along the way and said, "Yeah, that picture looks like a person made it. We should keep developing this model."
- Ajedi32 4y agoNot just image generating systems. Basically all neural network based AIs have a tendency to fail in ways that are very brain-like. GPT-3 produces output that seems to make sense as long as you aren't paying too close attention, image recognition AIs are more likely to mistake a cat for a dog than for something completely unrelated, speech recognition AIs often make very sensible seeming transcription errors, etc. Not to mention how revolutionary NNs have been in solving problems that brains find easy but machines have traditionally struggled with, and how terrible they are at things machines find easy and brains have traditionally struggled with. Maybe there's no relationship between the way NNs work and the way brains do, but the end result certainly seems to be similar.