But you’re not reversing anything with weights. They aren’t altered at all. There’s no secret human readable code, just training/test data and hyperparameters.

But you’re not reversing anything with weights. They aren’t altered at all. There’s no secret human readable code, just training/test data and hyperparameters. Even if they did give you access to the exact data set they used there’s not much chance you could do anything with it without millions of dollars worth of compute time and even then they’ve already trained the model on that data so the best you could do is start from scratch and see if you could get a better result in which case your time is better spent on building your own data set and RLHF process. Like what value do you think you’re going to get anyways?