They just change the input data of the LLM and/or the reward model. Or better they shift the distribution by finetuning the model on curated data. But no, no

They just change the input data of the LLM and/or the reward model. Or better they shift the distribution by finetuning the model on curated data. But no, no one change the parameters manually, it's just too complex, an artificial brain.