3 ms·
You can absolutely tune causal LLMs. In fact the original idea with GPTs was that you had to tune them before they'd be useful for anything.
by mathiaspoint 1y ago
You can absolutely tune causal LLMs. In fact the original idea with GPTs was that you had to tune them before they'd be useful for anything.
- gdiamos 1y agoYes I agree you can tune autoregressive LLMs You can also tune diffusion LLMs After doing so, the diffusion LLM will be able to generate more tokens/sec during inference