I hoped they would shed some light on how the model was trained (are there preference models? Or is this all about the training data?), but there is no such sub

I hoped they would shed some light on how the model was trained (are there preference models? Or is this all about the training data?), but there is no such substance.