3 ms·
Hi! I'm a co-author on the paper (Mark Dredze). The arxiv paper is written for researchers who are building these models. We benefited tremendously from readin
by mdredze 4y ago
Hi! I'm a co-author on the paper (Mark Dredze).
The arxiv paper is written for researchers who are building these models. We benefited tremendously from reading papers on GPT-3, PaLM, Chinchilla, Galactica, Gopher, Bloom, OPT, most of which are closed models. We are contributing back to that community, and the collective experience of people who are training these models. We learned a lot that will help others who are making their own decisions about how to train models.
If you are looking for an API to use, this isn't for you.
- wanderingmind 4y agoScience means objective reproduction, to give back in science will mean giving the full model that others can explore and test and improve on. Giving a bunch of words doesn't help the science move forward.
- ebalit 4y agoA "bunch of words" has been the standard for the dissemination of scientific results for decades. Worse, those results are often locked behind a paywall... Publishing models is definitely better than only a paper, but I think you're being unnecessarily harsh in that case. We would all prefer it if OpenAI released a proper paper about GPT4, for instance, even if they did not release the complete model alongside it.
- wanderingmind 4y agoBeing harsh is not my intent, definitely not at a personal level. OpenAI is definitely not a role model, but at best they release API that can be tested and explored and bench marked. At least, it moves the needle. In this case, there is no way to test let alone reproduce. I think people need to expect more from scientists and researchers and call them out when they fall short