4 ms·
Hmm this is a good point, diffusion requires several (many?) inference passes as you refine the noise into an image, right? Makes sense that this is more expens
by amilios 3y ago
Hmm this is a good point, diffusion requires several (many?) inference passes as you refine the noise into an image, right? Makes sense that this is more expensive to scale up. Thanks for the explanation!
- brucethemoose2 3y agoTechnically the llms require a pass for each token, but the passes are cheaper and benefit more from batching.