4 ms·
A big discussion on this happened here as well https://news.ycombinator.com/item?id=44057820 https://news.ycombinator.com/item?id=44057820 There is quite a bit
by mountainriver 1y ago
A big discussion on this happened here as well https://news.ycombinator.com/item?id=44057820 https://news.ycombinator.com/item?id=44057820
There is quite a bit of evidence diffusion models work better at reasoning because they don't suffer from early token bias.
https://github.com/HKUNLP/diffusion-vs-ar https://github.com/HKUNLP/diffusion-vs-ar
https://arxiv.org/html/2410.14157v3 https://arxiv.org/html/2410.14157v3