3 ms·
Gwern had a good piece on it. It's crazy expensive to train and run, not something for a laptop or gaming rig. The claim is it's really not that interesting, ju
by verdverm 6y ago
Gwern had a good piece on it. It's crazy expensive to train and run, not something for a laptop or gaming rig. The claim is it's really not that interesting, just a bigger GPT-2. It will be more interesting to see similar results with smaller models that are more accessible
- peterthehacker 6y agoThat’s what it looks like. There’s a comment in this issue calling that out also. [0] Considering how inaccessible it is I’m curious why there’s so much hype around it. Just the cost/benefit of cloud compute resources needed to run the model looks really bad. All of these hypothetical use cases being discussed in other threads would be financially unsustainable. Granted, it’s still yet to be seen how the smaller models will perform. Looking forward to experimenting with those once they’re released! [0] https://github.com/openai/gpt-3/issues/1#issuecomment-636008427 https://github.com/openai/gpt-3/issues/1#issuecomment-636008...
- verdverm 6y agoI was thinking about more research which leads to alternatives which are smaller, not the smaller GPT-3.