3 ms·
That sounds like it would be far less computationally efficient. How can there be an efficiency gain over autoregression?
by clbrmbr 2y ago
That sounds like it would be far less computationally efficient. How can there be an efficiency gain over autoregression?
- emporas 2y agoGPUs compute in two dimensional vectors, and auto-regressive models compute in sequence. Diffusion seems to me to be the more efficient and natural fit for computation on GPUs. When o3 solved the ARC[1] challenge, Sam Altman said it was recognizing the image pixel by pixel linearly, and i found it pretty hilarious that they start by using a chip which computes in two dimensions, they use it to compute a line, and that line is a two dimensional image of the ARC challenge. [1] https://arcprize.org/ https://arcprize.org/