> Release the data, and if it ends up causing a privacy scandal... We can't prove that a model like llama will never produce a segment of its training data set

> Release the data, and if it ends up causing a privacy scandal... We can't prove that a model like llama will never produce a segment of its training data set verbatim. Any potential privacy scandal is already in motion. My cynical assumption is that Meta knows that competitors like OpenAI have PR-bombs in their trained model and therefore would never opensource the weights.