2 ms·
People keep forgetting that the models didn't figure out how to have conversations on their own - that part was trained after slurping the whole Internet, and i
by TeMPOraL 2y ago
People keep forgetting that the models didn't figure out how to have conversations on their own - that part was trained after slurping the whole Internet, and it's people[0] - specifically, people employed for that purpose - who supplied example conversations.
The way the model talks is exactly what you'd expect for a human writing example conversations to create, when given no specific instructions wrt. style. Correct, polite, professional, nice.
(However, the models pick all kinds of styles from the "slurp the whole Internet" stage, which is why prompting them directly is so effective at changing their communication style to whatever you want.)
--
[0] - At least initially. Nowadays, LLMs generate data for LLMs.
- mitthrowaway2 2y agoWhat people actually keep forgetting is that this isn't the distribution of the training data. Predict-the-raw-internet models don't get released by AI corporations anymore. Back in 2023 when models had less effective RLHF treatment, the result was Microsoft Sidney.