3 ms·
The train loop is wrong no ? neither x0s and eps are used in the expression of xts so it loons like your training to predict random noise
by davidguetta 2y ago
The train loop is wrong no ? neither x0s and eps are used in the expression of xts so it loons like your training to predict random noise
- fisian 2y agoYes, should be the same as the equation before. Like this: xts = alpha_bar[t].sqrt() * x0s + (1.-alpha_bar[t]).sqrt() * eps Additionally, the code isn't consistent. In the sampling code a time embedding is used, while in training it isn't.
- reasonableklout 2y agoOops, you're right. Fixed, thanks.
- kmacdough 2y agoNot sure which eq you refer to, but from what I understand, the network never network "sees" the correct images. Rather, the network must learn to infer the information indirectly through the loss function. The loss function encodes information about the noise and, because the network sees the noised up image exactly, this is equivalent to learning about the actual sample images. It's worth noting that you could design a loss function measuring the difference between the output and the real images. This contains equivalent information, but it turns out that the properties of gaussian noise make it much more conducive estimating the gradient. But point being, the information on the true images is in the loop albeit only through the lense of some noise.