2 ms·
If it's still retrieving an image and not reconstructing it, if the dataset is large enough that's decently fine, but this is generally not how diffusion models
by satvikpendem 3y ago
If it's still retrieving an image and not reconstructing it, if the dataset is large enough that's decently fine, but this is generally not how diffusion models work in general and I'd have expected the model to map the fMRI data to a wholly new image.
- jph00 3y agoPlease read the paper. Or at least the blog post. It's really quite readable. They explain that they've done both retrieval and reconstruction, and have lots of pictures showing examples of each. https://medarc-ai.github.io/mindeye/ https://medarc-ai.github.io/mindeye/
- deleted 3y ago[deleted]
- RC_ITR 3y agoIf you can retrieve an image using a latent vector, it’s trivial to reconstruct it (decently well) with a diffusion model.
- rocqua 3y agoThey tested themselves both on retrieval and reconstruction.