I don't think anyone knows of the source data is encoded somehow in the model. Sure it is not explicitely, but it has been shown (at least for simpler models bu

I don't think anyone knows of the source data is encoded somehow in the model. Sure it is not explicitely, but it has been shown (at least for simpler models but also for copilot) that you can with the right prompts get them to output exact copies of results (even with possible typos in comments). That to me means the models do in fact somehow contain the source. On the topic of derivative, backpropagation the method of training a model relies specifically on calculating the gradients or derivatives of your data.