>And there’s something that I’ve noticed: LLM-generated prose has a kind of… vibe. RLHF GPT (and generally models with "helpful assistant" post training) prose

>And there’s something that I’ve noticed: LLM-generated prose has a kind of… vibe. RLHF GPT (and generally models with "helpful assistant" post training) prose has a vibe because Open ai's training has specifically pushed it that way. Some kind of mode collapse ? It's not really a LLM thing. https://nostalgebraist.tumblr.com/post/706441900479152128/novel-writing-chatgpt-vs-code-davinci-002 https://nostalgebraist.tumblr.com/post/706441900479152128/no...