That is what Biderman suggests at the end of article. The problem with that is that models can produce novel information not found in the training data by corre

That is what Biderman suggests at the end of article. The problem with that is that models can produce novel information not found in the training data by correlating information that was not associated with each other directly in the training data. Realistically it should be up to the person running the inference to decide what information the model should be able to produce.