4 ms·
The images look like Stable Diffusion riffs based on an example image. Might it be that they are doing something like this: * presenting some images to a subj
by kazinator 4y ago
The images look like Stable Diffusion riffs based on an example image.
Might it be that they are doing something like this:
* presenting some images to a subject, converting them to some captured MRI signals.
* training an A.I. image generation system on those same images, using the MRI signal as the associated text, instead of text.
* then generating images using MRI patterns as prompts
Still, scary what the method is able to infer.
- deleted 4y ago[deleted]
- lgats 4y ago> Firstly, we learn an effective self-supervised representation of fMRI data using mask modeling in a large latent space inspired by the sparse coding of information in the primary visual cortex. Then by augmenting a latent diffusion model with double-conditioning, we show that MinD-Vis can reconstruct highly plausible images with semantically matching details from brain recordings using very few paired annotations. https://arxiv.org/pdf/2211.06956.pdf https://arxiv.org/pdf/2211.06956.pdf