It's far worse than that: to attribute a particular output to an input you don't just need the input data, you need the gradient updates that data caused in the

It's far worse than that: to attribute a particular output to an input you don't just need the input data, you need the gradient updates that data caused in the training run. A couple hundred gigabytes input tokens times 175 billion parameters equals... impossibility.