4 ms·
If there is >50% of something, I wouldn't be surprised if a model chooses it 100% of time.
by LudwigNagasena 3y ago
If there is >50% of something, I wouldn't be surprised if a model chooses it 100% of time.
- vikramkr 3y agoI know this is an old thread but also just remembered - what folks are describing in this thread (where it just picks the mode) is actually explicitly one of the reasons we use diffusion instead of GANs - it's called mode collapse and it's something people spend a lot of time and effort trying to prevent: https://proceedings.neurips.cc/paper/2017/file/44a2e0804995faf8d2e3b084a1e2db1d-Paper.pdf https://proceedings.neurips.cc/paper/2017/file/44a2e0804995f...
- vikramkr 3y agoI"m really confused by all these responses in this vein. If the model just chooses the most likely thing 100% of the time that's an entirely useless piece of software! Just use a stock photo or a bar chart and pick the mode!
- LudwigNagasena 3y agoWhether it is useless or not depends on your needs.
- vikramkr 3y agoNo because if it always produces a deterministic image it's just lookup table. The whole point is that it's generative ai, not a way to burn all the computational power to generate some summary statistics