3 ms·
The answer is of course it's possible, so long as you have a couple of gigabytes spare for the acknowledgements page. Any construct worth attributing will have
by nonrandomstring 4y ago
The answer is of course it's possible, so long as you have a couple of
gigabytes spare for the acknowledgements page. Any construct worth
attributing will have roots in billions of parameters.
- ProlificInquiry 4y agoIt's far worse than that: to attribute a particular output to an input you don't just need the input data, you need the gradient updates that data caused in the training run. A couple hundred gigabytes input tokens times 175 billion parameters equals... impossibility.