3 ms·
Is there anything about this specific to LLMs, or could you use it for any transformer based model? It seems like they made a modified transformer.
by superdisk 3y ago
Is there anything about this specific to LLMs, or could you use it for any transformer based model? It seems like they made a modified transformer.
- kromem 3y agoIt seems like it could be any transformer, which is exciting now that even in imaging gradient transformers are all the rage. But ideally we'd need to see this result in other transformers (but I have a hard time seeing why it wouldn't be the case).
- riskable 3y agoAt the very least it could be used to reduce the requirements and speed up the prompt recognition step(s) of image-based generative AI. "Stable Diffusion 3 XS" will use ternary? Here's to hoping :)