4 ms·
Yes, notice how much variance there is between the images. They are the same types of building, or similar sized animals, but the details and shapes can be wild
by tomxor 4y ago
Yes, notice how much variance there is between the images. They are the same types of building, or similar sized animals, but the details and shapes can be wildly different.
It's pretty clear what's happening is FMRI meaning -> stable diffusion image generation. Now this _is_ cool, but it's important to understand all that's happening is the natural language input to stable diffusion has been replaced with FMRI input. i.e the image is still generated by stable diffusion, not you, you are just inputting meaning by visualising a separate image, and that meaning is abstract enough to be coarsely learned through an FMRI... but ultimately the image is not produced by your brain, which will probably be more obvious to any of the test subjects.
- not2b 4y agoYes, how do we know that visual rather than verbal information is even being processed? I can get a decent image from Stable Diffusion or Dall-E from a pure text prompt, and if that's added to a very basic scribble and we do img2img a much better result can be produced, but it might have little to do with what the person is actually seeing.
- tomxor 4y agoIt's a good point, but actually a fairly simple one to test: try the same model on two different test subjects with no overlapping languages (preferably with very different languages that don't share many constructs).