2 ms·
Are there any diffusion-based or otherwise non-transformer-based models in mainstream use?
by inigyou 3mo ago
Are there any diffusion-based or otherwise non-transformer-based models in mainstream use?
- moralestapia 3mo agoIf by mainstream you mean "ChatGPT" or "Claude", then no. But also, no one really knows as they're closed.
- Sharlin 3mo agoIf you include non-language models, yes.
- inigyou 3mo agoWe are clearly talking about language models
- Timwi 3mo agoImage GenAI is diffusion-based, and I would say the image GenAI in Claude, Gemini and ChatGPT are all “in mainstream use”. I've heard of attempts to use diffusion models to generate text or code as well, but my impression is that it just didn't yield the level of results necessary to dethrone a frontier transformer model.