10 ms·
Look no further than here for decoding more than one following token: https://hao-ai-lab.github.io/blogs/cllm/ https://hao-ai-lab.github.io/blogs/cllm/
by samus 2y ago
Look no further than here for decoding more than one following token:
https://hao-ai-lab.github.io/blogs/cllm/ https://hao-ai-lab.github.io/blogs/cllm/
- xucian 2y agonow I remember seeing this somewhere, perhaps in another thread? it's nice to see progress. from what I understand, this is already actionable (https://github.com/hao-ai-lab/Consistency_LLM https://github.com/hao-ai-lab/Consistency_LLM) and perhaps giga-models like gpt4 (gpt5?) are already being upgraded to use this as I'm writing thought this is still about token prediction. I actually foresee many more incremental improvements like this, we're in the "polishing" phase of LLMs, I don't think there'll soon be a ChatGPT breakthrough moment in the ChatGPT itself, just these incremental improvs + the expected gain from any energy efficiency improv + any improv from just adding more tflops xnx mentioned John Carmack which seems to work on what I'm looking for, I'm really curious what this guy does