3 ms·
Yes, it is and I agree with you. I worked in a lab where I had to reproduce others peoples code in Java. I never finished any of those projects. For Example G
by zitterbewegung 6y ago
Yes, it is and I agree with you.
I worked in a lab where I had to reproduce others peoples code in Java. I never finished any of those projects.
For Example GPT-2 would need around ~$50k to reproduce from scratch. GPT-3 is probably a few orders of magnitude than that. How would anyone reproduce it unless they are a company? I've seen NVIDIA reproduce some results.
Also, most of the issues are you don't have the datasets and after the PhD students graduate and the professor gets a job your access of the datasets go away like bitrot.