3 ms·
Yea GPT2 requires a bit more ram than on the 10 or 20 aeries TI cards . My point I think was unclear was the issue of reproducing the paper from scratch (I gue
by zitterbewegung 7y ago
Yea GPT2 requires a bit more ram than on the 10 or 20 aeries TI cards .
My point I think was unclear was the issue of reproducing the paper from scratch (I guess the model is enough ?) not sure how those papers are peer reviewed unless they also send the dataset to the reviewers ?
I also was unclear was when I said reproducing I mean to just get a model that has already been pretrained. I agree with your points .
- nl 7y agoPeer review almost never means reproducing the model, but that isn't because of the dataset (which is usually available to the reviewer) but because that's not what a peer review is! A peer review isn't an adversarial process where you think that the person has done something wrong. Instead, it's extra eyes on it to make sure they have thought of everything, and to say what additional tests might be needed and why.