3 ms·
LLM writing style is trained in by data labellers, it’s not just emergent behavior from being trained on internet texts.
by andy99 3mo ago
LLM writing style is trained in by data labellers, it’s not just emergent behavior from being trained on internet texts.
- embedding-shape 3mo agoUltimately it's a mix-match of everything, including whatever data the pre-training uses and how exactly they do the post-training. I don't think you can say there is a single factor that decides the writing style, unless you have some particular insight into some specific pipeline. Generally though, they output text that looks like the human text they ingested for training.