4 ms·
now I remember seeing this somewhere, perhaps in another thread? it's nice to see progress. from what I understand, this is already actionable (https://github.
by xucian 2y ago
now I remember seeing this somewhere, perhaps in another thread?
it's nice to see progress. from what I understand, this is already actionable (https://github.com/hao-ai-lab/Consistency_LLM https://github.com/hao-ai-lab/Consistency_LLM) and perhaps giga-models like gpt4 (gpt5?) are already being upgraded to use this as I'm writing
thought this is still about token prediction. I actually foresee many more incremental improvements like this, we're in the "polishing" phase of LLMs, I don't think there'll soon be a ChatGPT breakthrough moment in the ChatGPT itself, just these incremental improvs + the expected gain from any energy efficiency improv + any improv from just adding more tflops
xnx mentioned John Carmack which seems to work on what I'm looking for, I'm really curious what this guy does