3 ms·
One could refer to old-style flash powder lamps as "firecrackers" - which did give usable light for photography, quite analogous how a current LLM inference pro
by eMPee584 1mo ago
One could refer to old-style flash powder lamps as "firecrackers" - which did give usable light for photography, quite analogous how a current LLM inference process generates brief "flashes" of intelligence, each time devouring the context window and spitting out a chunk of tokens. Just like with combustion engines or digital processors: at some point, a fast-cycled process is practically indiscernible from a continuous process.