4 ms·
> How many of us have seen an LLM produce page-fuls of output, stop, suddenly erase it all, and then balk? The LLM needs to re-analyze that output impassively i
by lgas 1y ago
> How many of us have seen an LLM produce page-fuls of output, stop, suddenly erase it all, and then balk? The LLM needs to re-analyze that output impassively in order to detect that it crossed an undetected bright line.
That's not what's happening here. A separate process is monitoring for content violations and causing it to be erased. There's no re-analysis going on.