3 ms·

I'm not sure how this connects. Diffusion models are great for certain tasks, not for others. They have sort of a niche use in audio and are the SOTA for imag

by ozr 3y ago

I'm not sure how this connects. Diffusion models are great for certain tasks, not for others. They have sort of a niche use in audio and are the SOTA for image generation, but there is a lot of education (almost all) that doesn't apply to those domains. When we're talking about multimodal ML systems, the core is generally a transformer-based LLM with no diffusion component.

IanCal 3y ago
I think the point is that diffusion models improved at a very fast rate, how do we think things will look if LLMs (in whatever form) see the same rate of improvements?
- ozr 3y ago
  Ah, ok, I read that wrong. You're right. Thank you.