4 ms·
You can train a diffusion model using its own predictions as input, no problem at all.
by yorwba 1y ago
You can train a diffusion model using its own predictions as input, no problem at all.
- tripplyons 1y agoAt that point it is not following a diffusion training objective. I am aware of papers that do this, but I have not seen one that shows it as a better pretraining objective than something like v-prediction or flow matching.
- mxwsn 1y agoWhy is not the diffusion training objective? The technique is known as self-conditioning right? Is it an issue with conditional Tweedie's?