3 ms·
Modern LLMs are pre and post-trained on order of magnitudes more synthetic data than 'ground truth' or directly human-authored text. But you could say the synth
by dannyw 2mo ago
Modern LLMs are pre and post-trained on order of magnitudes more synthetic data than 'ground truth' or directly human-authored text. But you could say the synthetic data came from a LLM, and the lineage should trace all the way back to human text.
I hypothesize it partially explains why Claude's writing gets more Claudish with almost every model release.
- thewhitetulip 2mo agoI hate it when Claude keeps talking about old approach when you ask to modify it Apparently LLMs aren't smart enough to understand that when the topic changes nobody cared for the discarded solution!