3 ms·
Modern generative image models are trained on curated data, not raw internet data. Sometimes the captions are regenerated to fit the image better. Only high qua
by visarga 3y ago
Modern generative image models are trained on curated data, not raw internet data. Sometimes the captions are regenerated to fit the image better. Only high quality images with high quality descriptions.
- famouswaffles 3y agoI wouldn't call what Stable Diffusion et al are trained on "high quality". You need only look through the likes of LAION to see the kind of captions and images they get trained on. It's not random but it's not particularly curated either. Most of the time, any curation is done afterwards.
- visarga 3y agoHave you seen the BLIP paper? It's a bit old now, but it introduced a curation method. https://arxiv.org/abs/2201.12086 https://arxiv.org/abs/2201.12086