3 ms·
It looks like they use their own dataset and should be able to avoid that kind of information leakage. From their paper: "Our base diffusion model is a re-imp
by sorenjan 3y ago
It looks like they use their own dataset and should be able to avoid that kind of information leakage.
From their paper:
"Our base diffusion model is a re-implementation of the Latent Diffusion Model [42] that has been trained on an internal dataset of image-text pairs with input resolution 512×512×3 "
They also use multi-view datasets during training, but presumably they haven't included those in the diffusion pretraining.
"Training Dataset To learn a generalizable diffusion prior for novel view synthesis, we train on a mixture of the synthetic Objaverse [10] dataset and three real-world datasets: CO3D [38], MVImgNet [64], and RealEstate10K"
- fxtentacle 3y ago"For CO3D and RealEstate10K, we select the input views evenly from all the frames and use every 8th of the remaining frames for evaluation." to me sounds like the diffusion model had access to 87% of all frames for it to memorize. Then reconstructing from 3 views + diffusion is closer to using those 3 views to recall the memorized 100 views and use those for reconstruction.