3 ms·
Yes. How do they do it? Literally they must have PagerDuty set up to alert the team the second one of the labs releases anything.
by ttul 6mo ago
Yes. How do they do it? Literally they must have PagerDuty set up to alert the team the second one of the labs releases anything.
- beernet 6mo agoThey obviously collaborate with some of the labs prior to the official release date.
- sigbottle 6mo agoThat... is a more plausible explanation I didn't think of.
- danielhanchen 6mo agoYes we collab with them!
- qskousen 6mo agoSorry this is a bit of a tangent, but I noticed you also released UD quants of ERNIE-Image the same day it released, which as I understand requires generating a bunch of images. I've been working to do something similar with my CLI program ggufy, and was curious of you had any info you could share on the kind of compute you put into that, and if you generate full images or look at latents?
- danielhanchen 6mo agoYes we have started doing diffusion GGUFs but it's in it's infancy :) But yes we do generate images to test quants out!
- sigbottle 6mo agoIs quantization a mostly solved pipeline at this point? I thought that architectures were varied and weird enough where you can't just click a button, say "go optimize these weights", and go. I mean new models have new code that they want to operate on, right, so you'd have to analyze the code and insert the quantization at the right places, automatically, then make sure that doesn't degrade perf? Maybe I just don't understand how quantization works, but I thought quantization was a very nasty problem involving a lot of plumbing
- Readerium 6mo agothat is true. gguf does not support any Architecture. for the most recent example, as of April 16, 2026 (today) Turboquant isnt still added to GGUF