2 ms·
This understates the possible headroom as technical challenges are addressed - text diffusion is significantly less developed than autoregression with transform
by ainch 8mo ago
This understates the possible headroom as technical challenges are addressed - text diffusion is significantly less developed than autoregression with transformers, and Inception are breaking new ground.
- nylonstrung 8mo agoVery good point- if as much energy/money that's gone into ChatGPT style transformer LLMs were put into diffusion there's a good chance it would outperform in every dimension